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Abstract 



Understanding and classifying phases of matter is a vast and important area of research 
in modern physics. Of special interest are phases at low temperatures where quantum 
effects are dominant. Theoretical progress is thwarted by a general lack of analytical 
solutions for quantum many-body systems. Moreover, perturbation theory is often inade- 
quate in the strongly interacting regime. As a result, numerical approaches have become 
an indispensable tool to address such problems. In recent times, numerical approaches 
based on tensor networks have caught widespread attention. Tensor network algorithms 
draw on insights from Quantum Information theory to take advantage of special entangle- 
ment properties of low energy quantum many-body states of lattice models. Examples of 
popular tensor networks include Matrix Product States, Tree tensor Network, Multi-scale 
Entanglement Renormalization Ansatz and Projected Entangled Pair States. The main 
impediment of these methods comes from the fact that they can only represent states 
with a limited amount of entanglement. On the other hand, exploitation of symmetries, a 
powerful asset for numerical methods, has remained largely unexplored for a broad class 
of tensor networks algorithms. 

In this thesis we extend the formalism of tensor network algorithms to incorporate global 
internal symmetries. We describe how to both numerically protect the symmetry and 
exploit it for computational gain in tensor network simulations. Our formalism is generic. 
It can readily be adapted to specific tensor network representations and to a wide spectrum 
of physical symmetries. The latter includes conservation of total particle number (U(l) 
symmetry) and of total angular momentum (SU(2) symmetry), and also more exotic 
symmetries (anyonic systems). The generality of the formalism is due to the fact that 
the symmetry constraints are imposed at the level of individual tensors, in a way that is 



vu 



independent of the details of the tensor network. As a result, we are led to a framework 
of symmetric tensors. Such tensors are then used as building blocks for tensor network 
representations of quantum-many states in the presence of symmetry. 

For a long time several physical problems of immense interest have remained elusive 
to numerical methods mostly owing to extremely high simulation costs. These include 
systems of frustrated magnets and interacting fermions that are relevant in the context of 
quantum magnetism and high temperature superconductivity. With symmetry now as a 
potent ally, tensor network algorithms may finally be used to draw positive insights about 
such systems. 



Vlll 



Keywords: tensor networks, symmetry, U(l), SU(2), MERA, MPS, spin networks, 
anyons 

Australian and New Zealand Standard Research Classifications (ANZSRC): 
020401 Condensed Matter Characterisation Technique Development (50%) 
020603 Quantum Information, Computation and Communication (50%). 



IX 



Contents 



List of Tables xiii 

List of Figures xv 

1 Introduction 1 

1.1 Tensor network states and algorithms 2 

1.2 Symmetries 4 

1.3 Incorporating symmetries into tensor network algorithms 5 

1.4 Plan of the thesis 8 

2 Exploiting symmetries in MPS algorithms: An Example 11 

3 Tensor networks and symmetries: Theoretical formalism 25 

3.1 Errata 31 

4 Implementation of Abelian symmetries 33 

5 Implementation of non-Abelian symmetries I 57 

xi 



5.1 Preparatory Review: Tensor network formalism 58 

5.2 Representations of the group SU(2) 68 

5.3 Tensor product of representations 79 

5.4 Review: Fusion trees 89 

5.5 Block structure of SU(2)-invariant tensors 98 

5.6 Manipulations of SU (2) -invariant tensors 109 

5.7 Supplement: Examples of evaluating a spin network 120 

6 Implementation of non-Abelian symmetries II 125 

6.1 Tensor networks with SU(2) symmetry: A practical demonstration 142 

7 Conclusions and Outlook 153 
References 157 



xn 



List of Tables 



1.1 Popular tensor networks in one and two spatial dimensions 4 

1.2 Examples of global internal physical symmetries 5 

6.1 Example of spin assignment in an SU(2) MERA for the anti-ferromagnetic 

spin chain with L = 54 sites (or 108 spins) 147 



xm 



XIV 



List of Figures 



1.1 Computational gain obtained by exploiting the symmetry in an MPS al- 
gorithm. Computation time (in seconds) for one iteration of the infinite 
TEBD algorithm, as a function of the MPS bond dimension x is shown. 
Here x is a refinement parameter, a larger x leads to a better accuracy 
of the method. For sufficiently large X) exploiting symmetry leads to re- 
ductions in computation time. The horizontal line on this graph shows 
that this reduction in computation time equates to the ability to evaluate 
MPSs with a higher bond dimension x'- For the same cost per iteration in- 
curred when optimizing a regular MPS in MATLAB with bond dimension 
X = 220, one may choose instead to optimize a U(l)-symmetric MPS with 
X = 380 or an SU(2)-symmetric MPS with x = 1300 7 

5.1 Graphical representation of tensors by means of a shape e.g. circle or a 
"blob" with emanating lines corresponding to indices of the tensor. Indices 
may be incoming or outgoing as indicated by arrows, (i) Graphical rep- 
resentations of tensors with rank 0, 1 and 2, corresponding to a complex 
number c G C, a vector \v) E C^*' and a matrix M G C'"'^'^'. (ii) Graph- 
ical representation of a tensor T with components Tabcd with directions 
D = {'in', 'out', 'in', 'out'}. Notice that the indices emerge in a counter- 
clockwise order, perpendicular to the boundary of the blob; the first index 
is identified by the presence of by a dot within the blob close to the index. 
All arrows in a tensor diagram point downwards, that may be interpreted 
as choosing a metaphorical "time" that fiows downwards 59 

XV 



5.2 Transformations of a tensor: (i) Reversing direction of an index, Eq. (5.3). 
[a) Permutation of indices, Eq. (5.4). (ii) Fusion of indices a and b into 

d = a X b, Eq. (5.5); splitting of index d = a x b into a and b, Eq. (5.6). . . 61 

5.3 (i) Graphical representation of the matrix multiplication of two matrices 
R and S into a new matrix T, Eq. (5.7). (ii) Graphical representation of 
an example of the multiplication of two tensors R and S into a new tensor 

t, Eq. (5.8) 62 

5.4 Graphical representations of the five elementary steps 1-5 into which one 

can decompose the multiplication of the tensors of Eq. (5.8) 63 

5.5 (i) Factorization of a matrix T according to a singular value decomposition, 
Eq. (5.14). (ii) Factorization of a rank-4 tensor T according to one of several 
possible singular value decompositions 65 

5.6 (i) Example of a tensor network A/", (ii) Tensor T of which the tensor 
network A/" could be a representation, (iii) Tensor T can be obtained from 
Af through a sequence of contractions of pairs of tensors. Shading indicates 
the two tensors to be multiplied together at each step. The product tensor 

is depicted by a blob that covers the two tensors that are multiplied. ... 66 

5.7 (i) The graphical representation of the Clebsch-Gordan tensors: C^'^"" and 
^ split _ ^jj^ Tensors C**^"^" and C^^'^ are isometries and thus yield the Identity 
when contracted pairwise either as (i) or (ii), Eq. (5.72) 82 

5.8 The graphical representations of (i) the fusing tensor T*"'° and (ii) the 
splitting tensor. For fixed values of Ja,Jb and jab each of these tensors 
factorizes into a X and a C tensor 85 

5.9 Tensors T'^"""' and T'^"* are unitary and thus yield the Identity when con- 
tracted pairwise either as (i) or (ii) 88 



XVI 



5.10 Examples of two fusion trees r and r' that describe two different ways 
of considering the tensor product of (i) three vector spaces V^"^-* , V*-'^-' and 
V*-*"^ and (ii) four vector spaces V*^'^^ V'-^-', V^*"^ and V^^^ Fusion proceeds 
from top to bottom 90 

5.11 (i) In the tensor product of three irreps, two coupled bases that are labeled 
by fusion trees r (5.100) and r' (5.101) are related to one another by means 
of the recoupling coefficients F^jf^'^- ■ . (ii) A recoupling coefficient is 
given as the 'scalar product' of Q and Q' 92 

5.12 (i) The change of basis from the product basis to two different coupled 
bases in the fusion of three reducible representations is given in terms of 
two fusing tensors, (ii) The two coupled basis are related by means of 
the matrix F [Eq. (5.114)] that is obtained by contracting a tensor network 
made of tensors T'""" and tensors T^^"'. (iii) The components of F are given 
in terms of recoupling coefficients. This can be seen by performing the 
contraction piecewise. For fixed values of spins Ja,Jb,Jc,Jabc,Jd and Je 
the tensor network decomposes into a tensor network made of X tensors and 
a spin network. The former is contracted to obtain a matrix D' whereas the 
latter can be replaced by the Identity hjAsc+i ^^^ ^ recoupling coefficient 
[Fig. 5.11(ii)] 95 

5.13 The spin network that relates two coupled bases labeled by fusion trees 
T and t'. The spin network is proportional to the Identity, the propor- 
tionality factor is the coefficient 5'j^j^ j^ j^^ , which can be shown to be the 
product of two recoupling coefficients 96 

5.14 The transformation F that relates two different coupled bases, labeled by 
fusion trees r and r', when fusing four reducible representations. Matrix 

F decomposes into a degeneracy matrix Dj and the Identity 97 

xvii 



5. 15 Implication of the symmetry constraints fulfilled by a rank-1 SU(2)-invariant 
tensor with (i) an outgoing index, and (ii) an incoming index. The only 
allowed spin on the one index is j = 100 



5.16 Implication of the symmetry constraints fulfilled by rank-2 SU(2)-invariant 
tensors as resulting in the decomposition of the tensors into degeneracy 
tensors P and structural tensors 102 



5.17 Examples of the constraints fulfilled by rank-3 SU(2)-invariant tensors and 
their implication as resulting in the decomposition of the tensors into de- 
generacy tensors P and a Clebsch-Gordan tensors 105 



5.18 Two equivalent canonical decompositions of a rank-4 SU(2)-invariant tensor 
corresponding to two different ways of fusing the three incoming indices into 
the outgoing index 107 



5.19 (i) Graphical representation of the cup tensor. For simplicity, we choose 
the same graphical representation for a cup tensor applied to an index 
that carries a single spin j as well as for one that is applied on an index 
i that carries several spins j (possibly with degeneracy dj). (c = 2j + 1 is 
a normalization constant.) (ii) The analogous graphical representation of 
the cap tensor, (iii) Multiplying together a cup tensor and a cap tensor 
yields the Identity 110 



xvm 



5.20 Reversing an index of an SU(2)-invariant tensor by means of a cup tensor, 
(i) Reversing an index of an SU(2)-invariant tensor T with two outgoing 
indices to obtain a matrix T'. (ii) The reversal in (z) as performed on 
the canonical form of T. The degeneracy index can be reversed without 
affecting the components of the degeneracy tensor P. The reversal of the 
spin index equates to replacing the shaded region with a Clebsch-Gordan 
tensor and a numerical factor ttAt, which is absorbed into P to obtain P'. 
(iii) Reversing an index of a rank-3 SU(2)-invariant tensor, (iv) The reversal 
in [iii) as performed on the canonical form of T. The reversal of the spin 
index equates to replacing the shaded region with a Clebsch-Gordan tensor 
and a recoupling coefficient -foi/iajc- "^^^ recoupling coefficient appears as 
a result of introducing a resolution of Identity [Fig. 5.7(iii)] on the spins jb 
and ja and then simplifying the resulting diagram by applying the equality 

in Fig. 5.11(ii) Ill 

5.21 Permutation of indices [Fig. 5.2(ii)] as performed on the canonical form of 
a rank-3 SU(2)-invariant tensor. The permutation decomposes into permu- 
tation of the degeneracy indices and permutation of the spin indices. The 
latter equates to replacing the Clebsch-Gordan tensor and a 'cross' with a 
Clebsch-Gordan tensor and a numerical factor -R,°'*'T^o 114 

5.22 Illustration of the property that reversal of indices "commutes " with a 
permutation of them 115 

5.23 (i) Fusion of two outgoing indices of an SU(2)-invariant tensor by means 
of the fusing tensor T'""". (ii) Fusion in the canonical form of the tensor 
decomposes into the fusion of the degeneracy indices using tensor X*^"""", 
and the fusion of the spin indices using tensor C^"^''. The latter can be 
performed for free since the loop can directly be replaced with a straight 
line [Fig. 5.7(ii)]. (iii) Splitting of an outgoing index into two indices by 
means of the splitting tensor T^^"'. (iv) Splitting the index in the canonical 
form of the tensor 117 



XIX 



5.24 (i) Fusion of two incoming indices into an incoming index, and (ii) splitting 
an incoming index into two incoming indices can be performed in one of 
two way 118 



5.25 Computation times (in seconds) required to permute indices of a rank-four 
tensor T, as a function of the size of the indices. All four indices of T have 
the same size 9d, and therefore the tensor contains |r| = 9^d'^ coefficients. 
The figures compare the time required to perform these operations using 
a regular tensor and an SU(2)-invariant tensor, where in the second case 
each index contains three different values of spin j = 0, 1, 2, each with 
degeneracy d, and the canonical form of Eq. (5.161) is used. The upper 
figure shows the time required to permute two indices: For large d, ex- 
ploiting the symmetry of an SU(2)-invariant tensor by using the canonical 
form results in shorter computation times. The lower figure shows the time 
required to fuse two adjacent indices. In this case, maintaining the canon- 
ical form requires more computation time. Notice that in both figures the 
asymptotic cost scales as Old"^), or the size of T, since this is the number 
of coefficients which need to be rearranged. We note that the fixed-cost 
overheads associated with symmetric manipulations could potentially vary 
substantially with choice of programming language, compiler, and machine 
architecture. The results given here show the performance of our MATLAB 
implementation of SU(2) symmetry. 122 

XX 



5.26 Computation times (in seconds) required to multiply two matrices (upper 
panel) and to perform a singular value decomposition (lower panel), as a 
function of the size of the indices. Matrices of size 9d x 9d are considered. 
The figures compare the time required to perform these operations using 
regular matrices and SU(2)-invariant matrices, where for the SU(2) matri- 
ces each index contains three different values of the spin j = 0, 1, 2, each 
with degeneracy d, and the canonical form of Eq. (5.137) is used. That 
is, each matrix decomposes into three blocks of size d x d. For large d, 
exploiting the block diagonal form of SU(2)-invariant matrices results in 
shorter computation time for both multiplication and singular value de- 
composition. The asymptotic cost scales with d as 0{d^), while the size of 
the matrices grows as 0((i^). (For matrix multiplication, a tighter bound of 
0((i^'^) for the scaling of computational cost with d is seen in this example.) 
We note that the fixed-cost overheads associated with symmetric manip- 
ulations could potentially vary substantially with choice of programming 
language, compiler, and machine architecture. The results given here show 
the performance of our MATLAB implementation of SU(2) symmetry. . . 123 



5.27 Illustration of evaluating a spin network 124 



6.1 A tree decomposition V{T) of a rank-6 SU (2) -invariant tensor T with in- 
dices {ii,i2, ■ ■ ■ ,ie}- (All internal indices are summed over.) The tree 
decomposition consists of an SU(2)-invariant vector v, a set of splitting 
tensors and cup tensors that are attached to the incoming indices of T. 
The tree decomposition is obtained by applying a resolution of Identity 
X(t) on the tensor. The fusing and splitting tensors that constitute X(r) 
are connected together according to the fusion tree r 127 



XXI 



6.2 (i) Two different, but equivalent, tree decompositions V^{T) and V^{T) of 
a rank-4 SU(2)-invariant tensor T. The two decompositions are character- 
ized by different fusion trees t^ and r^. (ii) Tree decompositions V^{T) 
and P^(T) are obtained by applying the resolutions of Identity I{t^) and 
I(t^) on t 12^ 



6.3 Mapping a tree decomposition V^{T) of an SU(2)-invariant tensor T to an- 
other tree decomposition V^(T) by applying a resolution of Identity X(t^) 
to V^(T). We obtain an intermediate matrix T{t^ , r^) by contracting to- 
gether the splitting tensors in V^{T) and the fusing tensors in X(t^) and 
then multiply it with vector v^ to obtain vector w^ 130 



6.4 Permuting indices of a rank-4 SU (2) -invariant tensor T given in a tree 
decomposition. The "crossings" in the diagram can be absorbed into the 
tree by applying a resolution of Identity X(r') (for a given fusion tree r'). 
An intermediate matrix T{t, p, r') is obtained by contracting together the 
splitting tensors in T'(T), the permutation p and the fusing tensors in X(t'). 
The matrix is multiplied with the vector v to determine the updated vector 
v' 132 



6.5 (i) Fusion of two adjacent indices that belong to the same node of the tree 
decomposition proceeds by simply deleting the node to obtain the updated 
tree decomposition, (ii) Splitting an index corresponds to concatenating a 
new node to the tree decomposition 137 



6.6 The block-diagonal form of an SU(2)-invariant matrix is obtained from its 
tree decomposition by performing two multiplications. At each step the 
tensors within the shaded region are multiplied together. The same steps 
are also shown in the canonical form 13J 



xxii 



6.7 The five steps of tensor multiplication [Fig. 5.4] as adapted to the presence 
of the symmetry. For simplicity, the tree decompositions are not explicitly 
shown; the circle representing a tensor masks the tree decomposition of the 
tensor 139 



6.8 The number of spin networks to be evaluated when permuting or reshaping 
an SU(2)-invariant tensor, as a function of the number of indices of the 
tensor and the number of different spins j assigned to each index of the 
tensor. The plot shows the increase in the number of spin networks that 
are evaluated when reshaping tensors with increasing number of indices. 
It also illustrates the corresponding increase that results from increasing 
the number of different values of spin j that are assigned to the indices of 
the tensor. (Note that the number of spin networks does not depend on 
the degeneracy dimension of a spin j.) Consequently, the cost of reshaping 
tensors with a large number of indices may potentially become significant. 140 

6.9 A tensor network A/" made of SU(2)-invariant tensors represents an SU(2)- 
invariant tensor T. This is seen by means of two equalities. The first 
equality is obtained by inserting resolutions of the Identity I = WyW^ on 
each index connecting two tensors in A/". The second equality follows from 

the fact that each tensor in N' is SU(2)-invariant 142 

6.10 MERA for a system of L = 2 x 3^ = 18 sites, made of two layers of 
disentanglers u and isometrics w, and a top tensor t 143 

6.11 Error in ground state energy AE as a function of x fo^' the Heisenberg 
model with 2L = 108 spins and periodic boundary conditions, in the singlet 
sector, J = 0. The error is calculated with respect to the exact solutions, 
and is seen to decay polynomially with x for the particular choice of spins 
listed in Table 6.1 146 



xxm 



6.12 Low energy spectrum of H with L = 54 sites (=108 spins). Depicted states 
have spin J of zero (x, blue loops), one (+, red loops), or two (o, green 
loop). The superscript ^ close to the boundary of a loop indicates that the 
loop encloses two-fold degenerate states e.g., the second, third and fourth 
spin-1 triplets are twofold degenerate. The inset shows a zoom in of the 
region enclosed within the box. It compares the energies of the two-fold 
degenerate spin-one states within the box with those obtained using the 
regular MERA (black asterix points). Since the symmetry is not protected, 
the states obtained with the regular MERA corresponding to different mj 

do not have the same energies 148 

6.13 Memory cost (in number of components) for storing the MERA as a func- 
tion of the bond dimension x- The horizontal line on this graph shows that 
this reduction in memory cost equates to the ability to store MERAs with 
a higher bond dimension x'- For the same amount of memory required to 
store a MERA with bond dimension x = 15, one may choose instead to 
store a U(l)-symmetric MERA with x = 26 or an SU(2)-symmetric MERA 
with X = 39 149 

6.14 Computation time (in seconds) for one iteration of the MERA energy mini- 
mization algorithm, as a function of the bond dimension x- For sufficiently 
large Xi exploiting the SU(2) symmetry leads to reductions in computa- 
tion time. The horizontal line on this graph shows that this reduction in 
computation time equates to the ability to evaluate MERAs with a higher 
bond dimension x'- For the same cost per iteration incurred when optimiz- 
ing a regular MERA in MATLAB with bond dimension x = 18, one may 
choose instead to optimize a U(l)-symmetric MERA with x = 26 or an 
SU(2)-symmetric MERA x = 33 150 



XXIV 



Chapter 1 

Introduction 



The study of quantum many-body phenomena is of pivotal interest in modern physics. 
Important areas of research, such as the characterization of exotic phases of quantum 
matter and of quantum phase transitions(Sachdev, 1999), or even the possible realiza- 
tion(Kitaev, 2003; Nayak et al., 2008) of a quantum computer, rely on our understanding 
of collective phenomena in quantum many-body systems. Theoretical progress in these 
research areas is hindered both by a general lack of analytical results as well as the in- 
adequacy of perturbation theory in the strongly interacting regime where the interesting 
physics often lies. As a result, development of numerical approaches to probe such sys- 
tems has become a flourishing research industry. However, numerical methods are limited 
by staggering computational costs. 

The number of parameters required to describe a generic quantum many-body wavefunc- 
tion on a lattice grows exponentially with the number of sites in the lattice. An immediate 
consequence is that exact diagonalization can only be applied to small systems. In partic- 
ular, thermodynamic properties often remain inaccessible by this method. Conventional 
alternatives include Quantum Monte Carlo sampling techniques. These are well estab- 
lished numerical methods that have been used extensively in several areas of Mathematics 
and Physics. Of interest here is that these techniques have been applied(Evcrtz, 2003; 
Prokofev et al., 1998; Sandvik, 2005; Syljuasen and Sandvik, 2002) successfully to several 
quantum lattice models. On the other hand. Quantum Monte Carlo techniques suffer 
from the notorious sign problem(Henelius and Sandvik, 2000; Loh and Gubernatis, 1990) 
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that hinders their apphcation to certain systems of immense interest. Notable examples 
include systems of frustrated magnets and of interacting fermions that are relevant in 
the context of quantum magnetism and high temperature superconductivity(Anderson, 
1987). 

In recent years, new approaches based on tensor networks have caught widespread atten- 
tion. Such approaches can be regarded as generalizations of the density matrix renormal- 
ization group (DMRG) method(McCulloch, 2008; Schollwock, 2005a; White, 1992, 1993), 
which is highly successful for one- dimensional systems. The potential of tensor network 
algorithms relies on the fact that, as DMRG, they can address systems of frustrated spins 
and interacting fermions but, unlike DMRG, they can also be applied to two dimensional 
systems, both of large size and of infinite size. The main impediment of such methods 
comes from the fact that simulation costs increase rapidly with the amount of entan- 
glement in the system. Consequently, tensor networks can only represent states with 
a limited amount of entanglement. On the other hand, exploitation of symmetries has 
remained largely unexplored for a broad class of tensor networks algorithms. 

Symmetries, of fundamental importance in physics, require special treatment in numer- 
ical studies. Unless explicitly preserved at the algorithmic level, they are bound to be 
destroyed by the accumulation of small errors, in which case significant features of the 
system might be concealed. On the other hand, when properly handled, the presence of 
a symmetry can be exploited to reduce simulation costs. 

The goal of this thesis is to extend the tensor network formalism to the presence of 
symmetries. We develop a generic framework that can be applied to adapt any given 
tensor network representation and algorithm to both numerically protect symmetries and 
exploit them for computational gain. 



1.1 Tensor network states and algorithms 

Tensor networks are an efficient parameterization of low energy quantum many-body 
states of lattice models. The degrees of freedom of the model are arranged on a lattice 
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£ made of L sites where each site is described by a Hilbert space of dimension d. As 
a result, the Hilbert space dimension of C grows exponentially with the number of sites 
L. Thus, a generic quantum many-body state on the lattice is parameterized by expo- 
nentially many parameters. On the other hand, the dynamics of the system are typically 
governed by a local Hamiltonian if, that is, H decomposes as the sum of terms involving 
only a small number of sites, and whose strength decays with the distance between the 
sites. The locality of the dynamics often implies that only a relatively small amount of 
entanglement is present in the ground state. In such circumstances, tensor networks offer 
a good description of the ground state. Moreover, the description is efficient, in that the 
total number of parameters encoded into the tensor networks grows roughly linearly with 
L. 

Examples of tensor network states for one dimensional systems include the matrix product 
state(Fannes et al., 1992; Ostlund and Rommer, 1995; Pcrcz-Garcia et al., 2007) (MPS), 
which results naturally from both Wilson's numerical renormalization group(Wilson, 1975) 
and White's DMRG and is also used as a basis for simulation of time evolution, e.g. 
with the time evolving block decimation (TEBD)(Vidal, 2003, 2004, 2007a) algorithm 
and variations thereof, often collectively referred to as time-dependent DMRG (Daley 
et al., 2004; SchoUwock, 2005b; Vidal, 2003, 2004, 2007a; White and Feiguin, 2004); the 
tree tensor network(Shi et al., 2006) (TTN), which follows from coarse-graining schemes 
where the spins are blocked hierarchically; and the multi-scale entanglement renormal- 
ization ansatz(Evenbly and Vidal, 2009a; Giovannctti ct al., 2008; Pfcifer et al., 2009; 
Vidal, 2007b, 2008, 2010) (MERA), which results from a renormalization group proce- 
dure known as entanglement renormalization(Vidal, 2007b, 2010). For two dimensional 
lattices there are generalizations of these three tensor network states, namely projected 
entangled pair states(Gu et al., 2008; Jiang et al., 2008; Jordan et al., 2008; Murg et al., 
2007, 2009; Nishino and Okunishi, 1998; Nishio et al., 2004; Sierra and Martin-Delgado, 
1998; Verstraete and Cirac, 2004; Xie et al., 2009) (PEPS), 2D TTN,(Murg et al., 2010; 
Tagliacozzo et al, 2009) and 2D MERA(Aguado and Vidal, 2008; Cincio et al., 2008; Even- 
bly and Vidal, 2009b, 2010a,b; Konig et al., 2009) respectively. As variational ansatze, 
PEPS and 2D MERA are particularly interesting since they can be used to address large 
two-dimensional lattices, including systems of frustrated spins(Evenbly and Vidal, 2010a; 
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One dimensional 


Two dimensional 


MPS 


PEPS 


IDTTN 


2DTTN 


ID MERA 


2D MERA 



Table 1.1 - Popular tensor networks in one and two spatial dimensions. 

Murg et al., 2009) and interacting fermions,(Barthel et al., 2009; Corboz and Vidal, 2009; 
Corboz et al., 2010a,b; Gu et al., 2010; Kraus et al., 2010; Pineda et al., 2010; Pizorn 
and Verstraete, 2010; Shi et al., 2009) where Monte Carlo techniques fail due to the sign 
problem. 

Some popular tensor networks are summarized in table 1.1. 



1.2 Symmetries 



The presence of symmetries is a universal trait of physical theories. Symmetry has become 
one of the most powerful tools of theoretical physics, as it has become evident that 
practically all laws of nature originate in symmetries. The importance of symmetries 
in physical theories was firmly grounded by the famous Noether's theorem, a rigorous 
result that links the presence of a symmetry to the conservation of a physical quantity. 

In this thesis we will be concerned with symmetries exhibited in quantum lattice mod- 
els. The many-body Hamiltonian H may be invariant under certain transformations, 
which form a group Q of symmetries(Cornwell, 1997). Under the action of the symmetry 
transformation, the Hilbert space of the theory is divided into symmetry sectors labeled 
by quantum numbers or conserved charges. The symmetry group Q may be Abelian or 
non-Abelian, depending on whether or not the total effect of applying two symmetry 
transformations depends on the order in which the transformations are applied. The 
symmetry sectors associated with an Abelian symmetry correspond to one-dimensional 
invariant subspaces. In contrast, the dimension of the symmetry sectors associated with 
a non-Abelian symmetry may be larger than one. 
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Conserved physical quantity 


Symmetry group 


Abelian/non-Abelian 


Parity of particle number 


Z2 


Abelian 


Particle number, spin projection 


U(l) 


Abelian 


Total angular momentum, total spin 


SU(2) 


non-Abelian 


Particle number and spin 


U(l) X SU(2) 


non-Abelian 


Spin and isospin 


SU(2) X SU(2) 


non-Abelian 


Total anyonic charge 


e.g. SU(2), 


e.g. , non-Abelian 



Table 1.2 - Examples of global internal physical symmetries. 

On the lattice, one can distinguish between space symmetries, which correspond to some 
permutation of the sites of the lattice, and internal symmetries, which act on the vector 
space of each site. An example of space symmetry is invariance under translations by 
some unit cell, which leads to conservation of quasi-momentum. An example of internal 
symmetry is SU(2) invariance, e.g. spin isotropy in a quantum spin model. An internal 
symmetry can in turn be global, if it transforms the space of each of the lattice sites 
according to the same transformation (e.g. a spin independent rotation); or local, if each 
lattice site is transformed according to a different transformation (e.g. a spin-dependent 
rotation), as it is in the case of lattice gauge models. A global internal SU(2) symmetry 
gives rise to conservation of total spin. Table 1.2 lists some examples of Abelian and 
non-Abelian physical symmetries. 

By targeting a specific symmetry sector during a calculation, computational costs can 
often be significantly reduced while explicitly preserving the symmetry. It is therefore not 
surprising that symmetries play an important role in numerical approaches. 



1.3 Incorporating symmetries into tensor network al- 
gorithms 



Exploiting symmetries has been of great interest in numerical approaches, since it allows 
selection of a specific charge sector within the kinematic Hilbert space, and leads to 
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significant reduction of computational costs. 

In the context of tensor network algorithms, benefits of exploiting the symmetry have been 
extensively demonstrated especially in the context of MPS. Both space and internal sym- 
metries, Abelian and non-Abelian, have been thoroughly incorporated into DMRG code 
and have been exploited to obtain computational gains (Bcrgkvist et al., 2006; McCuUoch, 
2007; McCuUoch and Gulacsi, 2002; Ostlund and Rommer, 1995; Perez-Garcia et al., 2008; 
Pittel and Sandulescu, 2006; Ramasesha et al., 1996; Sanz et al., 2009; Schollwock, 2005b; 
Sierra and Nishino, 1997; Tatsuaki, 2000; White, 1992). 

Symmetries have also been used in more recent proposals to simulate time evolution with 
MPS(Cai et al., 2010; Daley et al., 2004, 2005; Danshita et al., 2007; Mishmash et al, 
2009; Muth et al., 2010; Schollwock, 2005b; Singh et al., 2010a; Vidal, 2004, 2007a; White 
and Feiguin, 2004). 

Figure 1.1 is demonstrative of the colossal computational gain that has been obtained by 
exploiting the symmetry in the context of the MPS. (In Fig. 6.14 we show an analogous 
comparison for exploiting symmetries in the context of the MERA.) 

However, when considering symmetries, it is important to notice that an MPS is a trivalent 
tensor network. That is, in an MPS each tensor has at most three indices. The Clebsch- 
Gordan coefficients(Cornwell, 1997) (or coupling coefficients) of a symmetry group are 
also trivalent, and this makes incorporating the symmetry into an MPS by considering 
symmetric tensors particularly simple. In contrast, tensor network states with a more 
elaborate network of tensors, such as MERA or PEPS, consist of tensors having a larger 
number of indices. In this case a more general formalism is required in order to exploit 
the symmetry. 

In this thesis we will describe how to incorporate a global internal symmetry, given by 
a compact and reducible group Q, into tensor network algorithms. We will develop a 
generic strategy that is independent of the details of the underlying tensor network. We 
will do this by imposing the symmetry constraints at the level of individual tensors that 
constitute the tensor network. We will then also describe how symmetric tensors are 
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Figure 1.1 - Computational gain obtained by exploiting the symmetry in an MPS algorithm. 
Computation time (in seconds) for one iteration of the infinite TEBD algorithm, as a function 
of the MPS bond dimension x is shown. Here x is a refinement parameter, a larger x leads 
to a better accuracy of the method. For sufficiently large x. exploiting symmetry leads to 
reductions in computation time. The horizontal line on this graph shows that this reduction 
in computation time equates to the ability to evaluate MPSs with a higher bond dimension 
X- For the same cost per iteration incurred when optimizing a regular MPS in MATLAB with 
bond dimension x = 220, one may choose instead to optimize a U(l)-symmetric MPS with 
X = 380 or an SU(2)-symmetric MPS with x = 1300. 



manipulated such that the symmetry is both 'preserved and exploited for computational 
gain. Having built a framework of symmetric tensors, we will adapt an arbitrary tensor 
network to the presence of symmetry by using symmetric tensors as building blocks for 
the tensor network. The resulting tensor network represents a class of quantum many- 
body wavefunctions that are invariant (or more generally covariant) under the symmetry 
transformation. Algorithms based on such symmetric tensor networks will also be adapted 
to the presence of symmetry. This will be achieved by expressing each step of an algorithm 
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in terms of symmetric manipulations of the tensors. 

As a concrete illustration, we will extensively describe the implementation of U(l) and 
SU(2) symmetries into the MPS and MERA. With these implementations at hand, we 
will demonstrate the colossal benefits of incorporating the symmetry into tensor network 
algorithms. These include addressing specific symmetry sectors of the Hilbert space, com- 
pactification of the tensor network representation and computational speedup in numerical 
simulations. For example, in a lattice spin model endowed with spin isotropy the ground 
state is constrained to the spin zero or singlet sector of the Hilbert space. Therefore, in a 
numerical probing for the state, it is sufficient to restrict attention to the singlet subspace. 
This can, in turn, potentially result in a substantial reduction of computational costs. 



1.4 Plan of the thesis 

This thesis is comprised of three published papers corresponding to chapters 2,3 and 4 
and additional chapters 5 and 6. The material in chapters 5 and 6 was under preparation 
for publication at the time of submitting this thesis. The following is a brief summary of 
all the chapters. 

In Chapter 2 we dive straight into the core of the problem. We describe the implemen- 
tation of a non-Abelian symmetry for the case of the simplest tensor network: the MPS. 
This will serve to illustrate the key points that are required to be considered when im- 
plementing symmetries into tensor network algorithms. In addition, this chapter also 
demonstrates the benefits of exploiting symmetries in the case of MPS algorithms. We 
adapt the infinite time evolving block decimation (iTEBD) algorithm to the presence of 
a global SU(2) symmetry. This is of interest in its own right since the iTEBD algorithm 
has been immensely successful in simulations of infinite ID quantum many-body systems. 
This is also the first implementation of a non-Abelian symmetry into the iTEBD algorithm 
and has resulted in a significant enhancement of this algorithm. 

In Chapter 3 we go beyond the class of MPS algorithms. We describe the general strategy 
to incorporate a wide spectrum of symmetries into more complex tensor network states and 
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algorithms. We consider tensor networks made of symmetric tensors, that is, tensors that 
are invariant under the action of the symmetry. We develop a formalism to characterize 
and manipulate symmetric tensors. 

In Chapter 4 we implement the general formalism for the case of an Abelian symmetry. 
The implementation of an Abelian symmetry is simplified by the fact that symmetric 
tensors are easier to characterize. In a basis labeled by the charges of the symmetry, 
a symmetric tensor has a sparse block structure. We explain how this block structure 
can be exploited for computational gain in a practical implementation of the symmetry. 
The benefits of exploiting the symmetry are numerically demonstrated by exploiting U(l) 
symmetry in the context of the MERA. 

In Chapters 5 and 6 we describe the implementation of a non-Abelian symmetry. The 
details of implementing the symmetry are more involved, since the structural tensors 
are highly non-trivial. However, the computational gain that results from exploiting a 
non-Abelian symmetry is significantly larger than that obtained by exploiting an Abelian 
symmetry. Moreover, the practical scheme presented to implement a non-Abelian symme- 
try can be readily extended to incorporate more exotic symmetry constraints such as those 
corresponding to the presence of anyonic degrees of freedom. The benefits of exploiting 
a non-Abelian symmetry are numerically demonstrated by means of our implementation 
of SU(2) symmetry in the context of the MERA. 

Finally, in Chapter 7 we draw conclusions and discuss potential applications and future 
directions of this work. 

Note on References: In addition to the references listed at the end of the thesis, chapter 
wise references appear at the end of chapters 2, 3 and 4 that correspond to published 
papers. 
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Chapter 2 



Exploiting symmetries in MPS algorithms: 
An Example 



We kick start the main discussion of the thesis by describing how to incorporate an SU(2) 
symmetry into a specific MPS algorithm: the iTEBD algorithm. The iTEBD algorithm 
has been immensely successful in simulations of infinite ID quantum many-body systems. 

We follow a straightforward implementation of the symmetry into the algorithm. We con- 
sider an MPS that is made of trivalent SU(2) invariant tensors. A trivalent SU(2) invariant 
tensor decomposes into two pieces. One piece contains the degrees of freedom whereas 
the other corresponds to the Clebsch-Gordan coefficients of SU(2). We describe how the 
iTEBD algorithm can be enhanced by exploiting this decomposition of the MPS tensors. 
The resulting symmetric algorithm is obtained to be 300 times faster (See Fig. 1.1). We 
use the symmetric algorithm for a numerical study of a critical quantum spin chain. 

This chapter serves to illustrate the main conceptual ingredients that are required to 
incorporate symmetries into tensor network algorithms. In the next chapter, we will 
generalize these ingredients by going beyond the specific details of the SU(2) symmetry 
group and the MPS representation. 
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1. Introduction 

Quantum many-body systems are characterized by a large Hilbert space, one whose dimension 
grows exponentially with the system's size. This makes the numerical study of generic quantum 
many-body phenomena computationally difficult. However, quantum systems are governed 
by Hamiltonians made of local interactions, that is, by highly non-generic operators. As a 
result, physically relevant states are atypical vectors in the Hilbert space and can sometimes 
be described efficiently. Systems in one spatial dimension are a prominent example. Here, the 
geometry of local interactions induces an anomalously small amount of bipartite correlations 
and an effective representation is often possible in terms of a trial wave function known as the 
matrix product state (MPS) [1, 2]. This, in turn, underlies the success of the density matrix 
renormalization group (DMRG) [3], which is an algorithm to compute ground states, and of 
several recent extensions of it [4, 5], including the time-evolving block decimation (TEBD) 
algorithm to simulate time evolution [4]. 

Symmetries, of fundamental importance in physics, require special treatment in numerical 
studies. Unless explicitly preserved at the algorithmic level, they are bound to be destroyed 
by the accumulation of small errors, in which case significant features of the system might 
be concealed. On the other hand, when properly handled, the presence of a symmetry can 
be exploited to reduce simulation costs. The latter has long been realized in the context of 
DMRG [3, 6]. More recently, the Abelian U(l) symmetry has been incorporated into the TEBD 
algorithm [7]. 

In this paper, we study how to enhance the TEBD algorithm in systems that are invariant 
under the action of a more general (possibly non-Abelian) symmetry, as given by a compact, 
completely reducible group G. (This includes finite groups as well as Lie groups such as 0(n), 
SO(n), U(n) and SU(n).) We present an explicit theoretical construction of a refined MPS 
representation with built-in symmetry and put forward a significantly faster TEBD algorithm 
that both preserves and exploits the symmetry. For simplicity and concreteness, we analyze 
the smallest non-Abelian case, the SU(2) group, which is relevant in the context of isotropic 
quantum spin systems. In contrast to the much simpler case of an Abelian U(l) symmetry [7], 
the analysis of the SU(2) symmetry already contains the major ingredients of an arbitrary 
compact, completely reducible group G. In addition, it can be cast in the language of spin 
operators, which is often more familiar to physicists when compared with group representation 
theory. As a test, we have computed the ground state of the spin- 1/2 antiferromagnetic 
Heisenberg chain, obtaining remarkably precise two-point correlators for both short and long 
distances. 

In preparation for describing the SU(2) MPS, we start by introducing a convenient vector 
basis and discuss the bipartite decomposition of states that are invariant under SU(2). 

2. Total spin basis 

Let y be a vector space on which SU(2) acts unitarily by means of transformations e'"^, where 
matrices Sx, Sy and Sj. close the Lie algebra SU(2), namely [5„, Sp] = iea^ySy, and v e M^. 
A total spin basis (TSB) \^^Jj e V satisfies the eigenvalue relations 

S'0 = JU + -^)0' SA'Pj=m\'Pj, (1) 
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and is associated with the direct sum decomposition of V into irreducible representations 
(irreps)ofSU(2)[8], 

V = 0(V^^'^ (8) V'-''^). (2) 

j 

Here, V'-'^ is a Jy -dimensional space that accounts for the degeneracy of the spin-j irrep and 
has basis l'^^) e V^^\ where t = 1, . . . ,dj, whereas V^^^ is a (2j + 1) -dimensional space that 

accommodates a spin-j irrep and has basis \^J2) e V^^\ where m is the projection of the spin 
in the z-direction, m = —j, . . . , j . Each vector of the TSB factorizes into degeneracy and irrep 
parts as I'^.^j,) = \Yt^)\fJ), where equation (1) determines only \YJ). 

3. Bipartite decomposition 

Consider an operator & : A ^- B that acts from vector space A to B and that commutes with the 
action of SU(2). Let S^^^ and S^^^ generate the action of the group on A and B. Then we have 

05[^] = S[«%, a=x,y,z. (3) 

Describing A and B with a TSB and employing Schur's lemma [8], @ splits into degeneracy 
and irrep parts as 



0= E E ®^ 



sjitimi I [A] > ,[B] 
J2t2in2 'j^miti'\J2t2m2' 



j \ ht2 / \ m / 

The operator is dual to a pure state |*) of a bipartite system with vector space A® B hy 
taking 

(5) 
([.«]|^^;|m ) 

\jm I m 'J— ml ' 

where oo is completely determined in terms of the Clebsch-Gordan coefficients 
(jij2mim2|jij2; jm) (see, for instance, [10]), namely 



0) 



^(_l)2y>-+i(2y + i)-i/2, (6) 



Uihm\m2\jiJ2\ 00) = Syi.yjS,,,,,.^,,^)^^ . (7) 

and where | ^) is an SU(2) singlet, that is, invariant under transformations acting simultaneously 
on A and B, or 

(Sf'*l-hS™)2|*)=0, (Sfl-h5f^)|*)=0. (8) 

Under the transformation in equation (5), equation (4) becomes 



jj\t\m.\ I [A] ,|[B] 
' J2t2m2 'Jimitii\j2t2m2' 
jlhmi J2t2m2 



!*)= E E^i 

jlhmi J2t2m2 



j \tlt2 
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The above decomposition is quite sensible: it shows that a coefficient Nj^l^'^^^ may be 
nonzero only if 

(i) ji = J2 (only the product of two spin j irreps can give rise to a spin irrep, that is, the 

singlet 1^)) and 
(ii) nil = —tn2, which guarantees that the ^-component of the spin vanishes. 

In addition, equation (9) embodies the essence of our strategy: to isolate the degrees of 
freedom that are not determined by the symmetry — in this case the degeneracy tensor T/^t^. We 
now consider the singular value decomposition (SVD) 

T,{t, = J2'^R^)rAv')t(S^)n, (10) 

t 

of the tensor Ti\t2 for ^ fixed j, and define 

\^]^')^j:RnrO, i^;.f)-i:5.,iitv (11) 

By combining equations (9)-(l 1), we arrive at our canonical symmetric bipartite decomposition 
(CSBD) 

i*)=E(E^/i*^^)i*;f))(E<irJ)ii-l))' (12) 

which is related to the Schmidt decomposition 

|*) = J]aJO[^])|$[«]) (13) 

a 

by the identifications a ^- (j7m), A.Q, ^- ^t<J^i ^^^ 

where some of the Schmidt coefficients Xa are negative. (If one prefers to work with non- 
negative Schmidt coefficients, negative signs can be absorbed into e.g. |0[f^).) 

More generally, a state n-,^ ) of a bipartite system C (g) D can be expressed in terms of 
TSBs for C and D as [9] 



|[CZ)]> _ 
'jtm I 

}Jij2 



\/_^jltiJ2t2'jlti''J2t2'j\ Z_^ ^j,mu2m2'jimi/\J2m2' j ' V-^-'; 

jjljl \"l'2 / \mm1m2 / 



where tensor X relates to degeneracy degrees of freedom and tensor C is given by the 
Clebsch-Gordan coefficients 

^imu2m2 = Uihmim2\jiJ2, jm). (16) 

4. Matrix product decomposition 

We now consider a chain of n quantum spins with spin 5, represented by a one-dimensional (ID) 
lattice where each site, labeled r (r = 1, . . . , n), carries a (2* -1- 1) -dimensional irrep of SU(2). 
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Figure 1 . Diagrammatic representation of tensors A and F of a MPS and tensors 
(rj, CO) and {X, C) of a SU(2) MPS. 



The coefficients Cmim2...m„ of a state |*) of the lattice, 

2s+l 2.V+I 

nj,\ ^ y^ ... y^ c |[i]\|[2]\...|W\ (17) 

where {|{^^)} is a basis for site r with S^*"^!!^^) = m\l^^), can be codified as a MPS [1, 2], 

^ _ \ ' p[l]mi 1 [l]p[2]m2T [2] p[«]m„ /io\ 

t-mi...m„ — / ^ ^ Q-, /^o-i ^ ai«2 '^Q'2 ' ' ff„-i ' \'^'->J 

Following the conventions of Vidal's paper [4], here A.^'^ are the Schmidt coefficients of |*) 
according to the bipartition [1 • • • r] : [r + 1 • • • n] of the spin chain and the tensor F^^'J™ relates 
the Schmidt vectors for consecutive bipartitions, 

\<^'r') = fl^S'"^Tt')\'^T''"')- (19) 

m = l 

When I*) is a singlet, that is, 

2 

^ '^ (20) 



jJ^Jf'M |^)=0, J]5f]|*)=0, 



equations (12) and (15) supersede equations (13) and (19) and each tensor X and F in equation 
(18) decomposes into degeneracy and irrep parts, see figure 1, 

K = hjtm) ^ vi 0)1, (21) 

pm" -pism") y T^jm (00^ 

^ aa' — ^ (jtm){j't'm') ~^ ^jtj't' ^j'm'sm"^ V^^^ 

where C is related to the Clebsch-Gordan coefficients C by 

^j'm'j"m" = (~1) (<^m') ^ j'm'j'm"- (23) 

Here, the term (co,^,,)"' arises in conjunction with the transformation equation (5). 
The SU(2) MPS is defined by equations (21) and (22). In this representation, the constraints 
imposed by the symmetry are used to our advantage. By splitting tensors A and F, we achieve 
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Figure 2. The TEBD algorithm is based on updating the MPS when a gate U 
acts on two neighboring sites. This diagram generalizes figure 3(i) of [11] after 
the replacements A ^- (r], co) and F -^ {X, C) of equations (21) and (22) for a 
SU(2) MPS. 



two goals simultaneously. On the one hand, the resulting MPS is guaranteed, by construction, 
to be invariant under SU(2) transformations. That is, any algorithm based on this representation 
will preserve the symmetry exactly and permanently. On the other hand, all the degrees of 
freedom of |^) are concentrated in smaller tensors r] and X (tensors oo and C are specified by 
the symmetry), and thus the SU(2) MPS is a more economical representation. If | • | denotes the 
number of coefficients of a tensor, then 

|A| ^ J](2j + \)dj -^ \ii\ ^ X] J;, (24) 

j j 

\T\ = {2s + \)\M\X'\ ^\X\^Y, dj^r^ (25) 

where X and A' are the tensors to the left and to the right of T and where, following spin 
composition rules, the last sum is restricted to pairs {j, j') such that \j — j'\ ^ s. 

5. Simulation of time evolution 

Our next step is to generalize the TEBD algorithm [4] to the simulation of SU(2)-invariant 
time evolution. This reduces to explaining how to update the SU(2) MPS when an SU(2)- 
invariant gate U acts between contiguous sites, see figure 2. The update is achieved by following 
steps analogous to those of the regular TEBD algorithm, see figure 3 of [1 1], involving tensor 
multiplications and one SVD (figure 3). Following the procedure described in [11], we first 
absorb the gate into the tensors of the MPS by contracting the tensor network in figure 3. 
Here Vxi and Vci enact a change of basis from the product basis { | jim i f i ) } (g) { | jpniptp) } to the 
coupled basis {\jmt)}. Specifically, Va are the Clebsch-Gordan coefficients that describe the 
change of basis \jimi) (g) Uptrip) — ^ \jm), and Vxi denotes the change of basis \jiti) (g) \jptp) -^ 
\jt). A straightforward choice for Vxi is an invertible linear map that uniquely associates each 
pair j. Mo a tuple ji, ti, jp, tp. Define (^xr)j|f, ; f , = 1 for each such unique association and as 
otherwise. The network contraction in figure 3 is a sum of the terms corresponding to various 
compatible values of ji, j2 and jV For each such term, the top line of tensors comprising the 
?y's, X's and Vx's are multiplied together. By Schur's lemma, the product of the tensors co's, 
C"s, Vc's and U on the lower leg is proportional to oo, with a proportionality constant a that 
depends on j, ji, j2, j3 and jp and that can be pre-computed because none of these tensors 
depend on |*). a is then absorbed into the product of the degeneracy matrices, which are then 
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Figure 3. Key steps of the TEBD algorithm for a SU(2) MPS, analogous to 
figures 3(i)-(iii) of [1 1] for a regular MPS. Once IJ has been applied to two spins, 
additional tensors Vxi and Vc; implement a unitary transformation required to 
reabsorb these spins into blocks and obtain an updated representation for the 
bipartition [1 • • • r] : [r + 1 • • • n]. Then, for each fixed value of the j indices 
(discontinuous lines), the ?]'s, X's and Vx's are multiplied together and the result, 
with a weight Uj^j^j^j coming from the product of the co's, C's, Vc^ and U (that 
can be pre-computed because none of these tensors depend on |*)), is added 
together to give rise to tensor T . 



added together to give rise to tensor T . A SVD of the tensor Tjtjt' ensues (equation (10)), giving 
rise to tensors R and S and the updated tensor r]^''^. The coupled basis \jmt) is reorganized 
back into product basis by contracting R and S with (V^,)"' (shown in figure 4(B) for R only). 
Once again, the contraction is effected by multiplying (Vx;)"' with R (or S) for each value 
of J. Finally, contract R (and S) with {r]^''~^^)~^ (and (??'''"^^^)~') to obtain the updated tensors 
r['"]andX'['-+^]. 

Note that all matrix multiplications and SVDs now involve smaller tensors, and only 
tensors X and r] of the SU(2) MPS need to be updated. This results in a substantial reduction 
in computational space and time and thus an increase in performance. For instance, the SVD 
of in figure 3 of [11], where |0| «s (2* + 1)^|A,|^ is now replaced with the SVD of ^jtjt' 
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Figure 4. The remaining steps of the TEBD algorithm. (A) The tensor T is 
singular value decomposed into R and S and an updated t]'^''^. In (B) and (C), 
the tensors R and S are reorganized into the updated tensors X'^''^ and X'^'"'^^. 



(see figure 3) for each value of j, where l^jo'/'l ~ (Xl/'>^-2i '^/)^- ^he cost Csvd(^) of 
computing the SVD of a matrix A grows roughly as |Ap/^ and is the most expensive 
manipulation of the TEBD algorithm. We obtain the following comparative costs: 

3 



CsvdO)- ((2^ + l)J][(2j + l)J,]| , 

;+2.v 



(26) 



(27) 



6. Example 

For illustrative purposes, we consider a quantum spin chain with ^ = 1/2 and with the 
Hamiltonian 



H = J](SMS1^^^1 + 5^51:^" + S^Sf ^"), 



(28) 



that is, the spin- 1/2 antiferromagnetic Heisenberg model, which is SU(2) invariant and quantum 
critical at zero temperature. Representing the ground state of this model with a MPS is 
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challenging, because both the critical character of the system and the presence of the SU(2) 
symmetry contribute to its entanglement. As a result, compared to a gapped system or a system 
with smaller symmetry, an accurate MPS approximation to the ground state of (28) requires a 
larger value of x ■ We have computed a SU(2) MPS approximation to the ground state of H, in 
the limit n ^- oo of an infinite chain, by simulating imaginary-time evolution [11] starting from 
a state made of nearest- neighbor singlets (Im)!'^^) ~ l-i/2)li/2'^))/^ • With the constraint 
^ dj = 600, we have obtained that the following irreps j, with degeneracies dj, contribute to 
the odd and even bipartitions'* of the resulting state: 



] 



dj 



1 2 3 4 J 



117 247 176 55 5 dj 



13 5 7 9 

2 2 2 2 2 



220 242 115 22 1 

Equations (24)-(27) show substantial computational gains, 

iri 10' c,vd(0) 9x10'° 

^ ^ = 50, ^ ^ = 300; (29) 

\X\ 2x105 Csvd(^) 3x10^ 

that is, with a regular MPS, storing the same state would require about 50 times more computer 
memory, whereas performing each SVD would be about 300 times slower. 

We have computed the two-point correlators^ C^{r) = (5™5f 1), and C^{r) = (5f ^S^'+'l), 
and the average C2(r) = (C^(r) -i- C2^(r))/2. For small r, they read as follows: 



r 


Ctir) 


C^ir) 


Ciir) 


1 


-0.148 002 247 48 


-0.147 429 206 05 


-0.147 715 726[7] 


2 


0.060 679 769 82 


0.060 679 769 91 


0.060 679 769[9] 


3 


-0.050 378 609 08 


-0.050 118 645 81 


-0.050 248 627[4] 


4 


0.034 652 776 14 


0.034 652 776 45 


0.034 652 776[3] 


5 


-0.030 978 529 6 


-0.030 802 190 1 


-0.030 890 36[0] 


6 


0.024 446 726 


0.024 446 726 


0.024 446 7[26] 


7 


-0.022 565 932 


-0.022 430 482 


-0.022 498 2[1] 



where, for C2(r), the square brackets show the first digits that differ from the exact solution ([12] 
and reference therein), from which we recover e.g. nine significant digits for r = 1. An 
expression for the correlator Cjir) is also known for large r^. There, for r «s 4000, 10000 
and 13 000, our results approximate the asymptotic solution with errors of 1, 5 and 10%, 
respectively, see figure 5. In comparison, with a regular MPS and similar computational 
resources, we lose three digits of precision for r = 1, whereas a 10% error is already achieved 
for r «s 500 instead of r «s 13 000. 

It is important to note that the appearance of two different correlators C2{r) and C^(r) is an 
artifact of the present algorithm and that the average C2(r) = (C^(r) -i- C^(r))/2 is a legitimate 
procedure to eliminate it, since it corresponds to taking as the ground state of the infinite chain 
an equally weighted superposition of the MPS and its translation by one site. It is also of interest 
to note the effect that a finite x in the MPS has on symmetries. If the infinite Heisenberg chain is 

'* For semi-integer spins, e.g. s — ^, tiie CSBD of equation (12) for a partition [I ■ ■ ■ r] : [r + I ■ ■ ■ n] of tiie chain 

lias only integer (semi-integer) values of j when r is even (odd). 

^ €2(1) (u) — A,S/) are computed by contracting a small tensor network involving the tensors (rj, (w) and (X, C) 

for two contiguous sites. For r > I, C™(r) is computed in the same way, but first we simulate r — 1 (SU(2) 

invariant) swap gates that bring the two relevant sites together. 

*■ We use c — 1.05 in equation (5.25) of Lukganov and Terras [13]. 
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Figure 5. Top: errors in the two-point correlator C2(r) for 1 ^ r ^ 7 when using 
SU(2) MPSs of different sizes x, e {350, 700, 1110, 1450, 1800, 2200}. Here, x 
is roughly |A| in equation (24), that is, the rank of an equivalent (regular) MPS. 
The lowest line, xg = 2200, shows the errors in the data presented in the table. 
Bottom: numerical results for C2(r) for up to r = 20000 sites, for different sizes 
X, , together with corresponding errors e, . 



addressed with a standard MPS, translation invariance is largely preserved but SU(2) invariance 
is clearly broken. If a SU(2) MPS is used instead, SU(2) invariance is exactly preserved but 
translation invariance is clearly broken. The extent to which either symmetry is broken decreases 
with increasing x • 



7. Final remarlts 

The above test with a critical spin- 1/2 chain unambiguously demonstrates the superiority of 
the SU(2) MPS and TEBD with respect to their non-symmetric versions. Promisingly, these 
techniques can now be used to address systems that remain otherwise largely inaccessible to 
numerical analysis due to the large dimension of the local Hilbert space. These systems include 
a chain made of large spins, say 5 = 4, or a spin ladder with several legs. We regard the latter as 
a chain with several spins per site, where each site decomposes into SU(2) irreps as in equation 
(2) [9]. 

In addition, the SU(2) MPS is not restricted to the representation of SU(2) singlets. On 
the one hand, it can be used to represent any SU(2) invariant mixed state p of the chain, which 
decomposes as (see equation (2)) 



P = 0Py(8)/2; + l. 



(30) 
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This is achieved by attaching, to the end of the chain, an environment E that duplicates the 
subspace V of the chain on which p is supported and by considering a singlet purification |^J^), 
where p = tr£|^J^)(*J^|. We first build a SU(2) MPS for the purification and then trace out 
E. The resulting structure is a matrix product representation that retains the advantages of the 
SU(2) MPS. In particular, note that when p corresponds to a single irrep j , 



m=-j 



the environment is a site with a spin j, and the chain together with the environment is just an 
extended spin chain, with the purification being of the form 



I* \- ^ V \^^W^) (32) 

m=-j 

On the other hand, the SU(2) MPS can also be modified to represent any pure state {-J) of 
the chain with well defined j and m. To achieve this, we first consider a mixed state p as in 
equation (31), that is, a symmetrization of lij)' ^^id then consider a purification \^p) for p as 
in equation (31), for which we can build a SU(2) MPS. Finally, we recall that |J.^,^) = (y^,^|*p), 

which leads to a simple, SU(2) MPS-like representation for l-J) in terms of the SU(2) MPS for 
the purification |^p). The time-evolution simulation techniques described in this paper can be 
applied to the above generalized representations. 

After nearly completing the original manuscript, we became aware of the related results 
obtained by I McCuUoch, which were derived independently in the context of DMRG [14]. 
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Chapter 3 



Tensor networks and symmetries: 
Theoretical formalism 



In this chapter we develop a generic theoretical formalism to incorporate a symmetry into 
tensor network algorithms. We consider a wide class of symmetries that are described 
by a compact and reducible group Q that is multiplicity free, that is, the tensor product 
of two charges of the group does not contain multiple copies of a charge. Our strategy 
revolves around tensors that are invariant under the action of the symmetry. As a result, 
we formulate a framework of symmetric tensors. 

A symmetric tensor transforms covariantly (or remains invariant) under the action of the 
symmetry. In a basis labeled by the symmetry charges, the tensor decomposes into a 
set of degeneracy tensors and structural tensors. While the degeneracy tensors contain 
the degrees of freedom, the components of the structural tensors are generalizations of 
the coupling coefficients of the group, and are determined completely by the symmetry. 
Moreover, any symmetry preserving manipulation of the tensor can be performed in parts. 
For instance, a permutation of the indices of a symmetric tensor breaks into the permu- 
tation of the corresponding degeneracy indices and the permutation of the corresponding 
structural indices. Therefore, this canonical decomposition of a symmetric tensor allows 
for both a compact description of the tensor and a computational speedup in numerical 
manipulations of it. 

We also point out a numerical connection to the formalism of spin networks{y[a,]oi , 1999; 

25 
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Penrose, 1971). A spin network is a mathematical object that appears, for example, in 
Loop Quantum Gravity(Rovclli, 1998), where it is used(Rovclli and Smolin, 1995) to fa- 
cilitate a description of quantum spacetime. In our formalism, a tensor network made of 
symmetric tensors decomposes into a linear superposition of spin networks. Also, manip- 
ulating a symmetric tensor network requires evaluating a spin network. Thus, our work 
highlights the importance of spin networks in the context of tensor network algorithms, 
thus setting the stage for cross-fertilization between these two areas of research. 
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Tensor network decompositions offer an efficient description of certain many-body states of a lattice system 
and are the basis of a wealth of numerical simulation algorithms. We discuss how to incorporate a global 
symmetry, given by a compact, completely reducible group Q, in tensor network decompositions and algorithms. 
This is achieved by considering tensors that are invariant under the action of the group Q. Each symmetric 
tensor decomposes into two types of tensors: degeneracy tensors, containing all the degrees of freedom, 
and structural tensors, which only depend on the symmetry group. In numerical calculations, the use of 
symmetric tensors ensures the preservation of the symmetry, allows selection of a specific symmetry sector, 
and significantly reduces computational costs. On the other hand, the resulting tensor network can be interpreted 
as a superposition of exponentially many spin networks. Spin networks are used extensively in loop quantum 
gravity, where they represent states of quantum geometry. Our work highlights their importance in the context 
of tensor network algorithms as well, thus setting the stage for cross-fertilization between these two areas of 
research. 
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Locality and symmetry are pivotal concepts in the for- 
mulation of physical theories. In a quantum many-body 
system, locality implies that the dynamics are governed by a 
Hamiltonian H that decomposes as the sum of terms involving 
only a small number of particles and whose strength decays 
with the distance between the particles. In turn, a symmetry of 
the Hamiltonian H allows us to organize the kinematic space 
of the theory according to the irreducible representations of 
the symmetry group. 

Both symmetry and locality can be exploited to obtain a 
more compact description of many-body states and to reduce 
computational costs in numerical simulations. In the case of 
symmetries, this has long been understood. Space symmetries, 
such as invariance under translations or rotations, as well as 
internal symmetries, such as particle number conservation or 
spin isotropy, divide the Hilbert space of the theory into sectors 
labeled by quantum numbers or charges. The Hamiltonian H is 
by definition block-diagonal in these sectors. If, for instance, 
the ground state is known to have zero momentum, it can 
be obtained by just diagonalizing the (comparatively small) 
zero-momentum block of H. 

In recent times, the far-reaching implications of locality for 
our ability to describe many-body systems have also started 
to unfold. The local character of the Hamiltonian H limits 
the amount of entanglement that low-energy states may have, 
and in a lattice system, restrictions on entanglement can be 
exploited to succinctly describe these states with a tensor 
network (TN) decomposition. Examples of TN decomposi- 
tions include matrix product states (MPS's) [1], projected 
entangled-pair states [2], and the multiscale entanglement 
renormalization ansatz (MERA) [3]. It is important to note that 
in a lattice made of A^ sites, where the Hilbert space dimension 
grows exponentially with A^, TN decompositions often offer an 
efficient description (with costs that scale roughly as A^). This 
allows for scalable simulations of quantum lattice systems, 
even in cases that are beyond the reach of standard Monte 
Carlo sampling techniques. As an example, the MERA has 
been recently used to investigate ground states of frustrated 
antiferromagnets [4]. 



In this article we investigate how to incorporate a global 
symmetry into a TN, so as to be able to simultaneously exploit 
both the locality and the symmetries of physical Hamiltonians 
to describe many-body states. Specifically, in order to represent 
a symmetric state that has a limited amount of entanglement, 
we use a TN made of symmetric tensors. This leads to 
an approximate, efficient decomposition that preserves the 
symmetry exactly. Moreover, a more compressed description 
is obtained by breaking each symmetric tensor into several 
degeneracy tensors (containing all the degrees of freedom of 
the original tensor) and structural tensors (completely fixed 
by the symmetry). This decomposition leads to a substantial 
reduction in computational costs and reveals a connection 
between TN algorithms and the formalism of spin networks [5] 
used in loop quantum gravity [6] . 

In the case of an MPS, global symmetries have already 
been studied by many authors (see, e.g., [1,7]) in the context of 
both one-dimensional quantum systems and two-dimensional 
(2D) classical systems. An MPS is a trivalent TN (i.e., 
each tensor has at most three indices) and symmetries are 
comparatively easy to characterize. The present analysis 
applies to the more challenging case of a generic TN 
decomposition (where tensors typically have more than three 
indices). 

We consider a lattice L made of N sites, where each site is 
described by a complex vector space V of finite dimension d. 
A pure state | *> e y®'^ of the lattice can be expanded as 



l*> 



XI (*)/i,2...'«l'l''2' ■■-.'«>, 



(1) 



■ .1«=1 



where | ij > denotes a basis of V for site s & C. For our puiposes, 
a TN decomposition for |^> consists ofa set of tensors T*"' and 
a network pattern or graph characterized by a set of veitices 
and a set of directed edges. Each tensor 7*"' sits at a vertex 
V of the graph, and is connected with neighboring tensors 
by bond indices according to the edges of the graph. The 
graph also contains N open edges, corresponding to the N 
physical indices ii^ii, ■ ■ ■ Jn- The d'^ coefficients (*),,,2...ia' 
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(ii) /■ (*,A) (/,,«,) (iii) k 




U„ U, [/, [/, 



U, U„ U„ [/„ 



FIG. 2. (Color online) Decomposition of tensors with one to four 
indices. The sums in (iv) run over the intermediate indices {e,ee,qe) 
and {f,^f,rf) in Eqs. (11) and (12). 



FIG. 1. (Color online) (i) Four-site state * expressed in terms 
of a tensor network made of three tensors connected according to a 
directed graph, (ii) Invariance of tensor T in Eq. (7). (iii) Invariance 
of a tensor network of symmetric tensors, Eq. (3). 



are expressed as [Fig. 1(1)] 



(*)n, 



= tTr 



ir<"> 



(2) 



namely, as the tensor product of the tensors r*^"' on all the 
vertices v, where the tensor trace tTr contracts all bond indices, 
so that only the physical indices ii,i2, ■ ■ ■ Jn remain on the 
right-hand side of Eq. (2). 

We also introduce a compact, completely reducible group 
Q. This includes finite groups as well as Lie groups such as 
0(«), S0(«), U(n), and SU(n). Let [/ : G -^ L(V) be a unitary 
matrix representation of Q on the space V of one site, so that 
for each g € Q, Ug : Y ^ Y denotes a unitary matrix and 
Ug^g^ = Ug, Ug^. Here we are interested in states |*) that are 
invariant under transformations of the form Uf^ [8], 



(f/,f ^|*> = I*), Wgeg. 



(3) 



The space V of one site decomposes as the direct sum of 
irreducible representations (irreps) of Q, 



0flf„v''s0(e«(g)V"), 



(4) 



where Y" denotes the irrep labeled with charge a and da is 
the number of times V" appears in V. We denote by a = 
the charge corresponding to the trivial irrep, so that V" = 
C and U" = 1. In Eq. (4) we have also rewritten the same 
decomposition in terms of a da -dimensional degeneracy space 
D". We choose a local basis \i) = \a,a^,,ma) in V, where 
a„ labels states within the degeneracy space W (i.e., a,, = 
1, . . . ,da) and m„ labels states within irrep V". In this basis, 
Ug reads 



Ug = ^{r^u;) 



(5) 



Recall that an operator M : Y ^ Y that commutes with the 
group, [M,Ug] = for all g € Q, decomposes as [9] 



M = 0(M"(8)r) 



(6) 



(Schur's lemma). Our goal is to characterize a TN made of 
symmetric tensors, namely, tensors that are invariant under the 
simultaneous action of Q on all their indices. A symmetric 
tensor T with, for example, two outgoing indices / and j and 
one incoming index k, fulfills [Fig. l(ii)] 



J2^Ug),'^Vg)rj^^hk(Wl),,, = {T),,y,,, Wg e g, 



(7) 



ijk 



where U, V, and W denote unitary matrix representations 
of Q. Clearly, this choice guarantees that Eq. (3) is satisfied 
[Fig. l(iii)]. Standard group representation theory results [9] 
imply that each symmetric tensor can be further decomposed in 
such a way that the degrees of freedom that are not fixed by the 
symmetry can be isolated (Fig. 2). Next we discuss the cases of 
tensors with a small number of indices. Recall that an index / of 
a tensor is associated with a vector space that decomposes as in 
Eq. (4); therefore, we can write i = {a,aa,ma), j = {b,Pi,,ni,), 
k = {c,Yc,Oc), and so on. 

One leg. A tensor T with only one index ( is invariant only 
if Q acts on it trivially, so the only relevant irrep is a = 0, and 
the index i = ao labels states within the degeneracy space V°. 

Two legs. Schur's lemma [9] establishes that a symmetric 
tensor T with one outgoing index / and one incoming index j 
decomposes as [cf. Eq. (6)] 



{T)iJ={P"\„f^,XQ'"'Un,, Q" 



S„hS„ 



(8) 



Thus, for fixed values of the charges a and b, (T)ij breaks into 
a degeneracy tensor /"'* (where only a = b is relevant) and 
another tensor Q"''. P"^ contains all the degrees of freedom 
of T that are not fixed by the symmetry, whereas Q"^ is 
completely determined hyQ. Another combination of outgoing 
and incoming indices, for example, two incoming indices, 
leads to a different form for tensor Q"'\ 

Three legs. The tensor product of two iiTeps with charges a 
and b can be decomposed as the direct sum of irreps. 



V" V* = A?;, 



(9) 



where A^^/^ denotes the number of copies of V that appear 
in the tensor product. For notational simplicity, from now on 
we assume that Q is multiplicity-free [10], that is, A^^''^ ^ 1, 
and denote by {Q"''^)m„ni,Oc the change of basis between the 
product basis \a,ma) (8) \b,nh) and the coupled basis \c,o^.). 
The Wigner-Eckart theorem states that a symmetric tensor T 
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with, for example, two outgoing indices i,j and one incoming 
index k, decomposes as 



inj, = (/'"'"■kft,.(G"'')„ 



(10) 



As before, for fixed values of the charges a,b, and c, (T)ijk 
factorizes into degeneracy tensors P"'"^ with all the degrees 
of freedom and structural tensors Q"*' (the Clebsch-Gordan 
coefficients) completely determined by the group Q. An 
analogous decomposition with different Q"*' holds for other 
combinations of incoming and outgoing indices. 

Four legs. The tensor product of three irreps V" (8) V* (g) V 
may contain several copies of an irrep V''. Let e be the charge 
that results from fusing a and b, V" V* = 0^ Kb'^''- We 
can use the values of e for which N^f^N^^ / (i.e., such that a 
and b fuse to e and e and c fuse to d) to label the different copies 
of V' that appear in V" ® V* ® V". Let (Qf"'),n,„,o,p,q, 
denote the change of basis between the product basis \ama) ® 
Ibrtb) (g) |cO(.> and the coupled basis \dpd\e) obtained by fusing 
to the intermediate basis | eqe > e V . Then a symmetric tensor 
T with three outgoing indices i, j, and k and one incoming 
index / = {d,S,i,pj) decomposes as 



(r),;.,= E iP"'"')..„y.sjQf"') 



m„ni,OcPdqe 



(11) 



where the sum is over all relevant values of the intermediate 
indices {e,ee,qe)- Alternatively, T can be decomposed as 






m„ni,o,.pjrf 



(12) 



where {Q."f''''^)m„ni,o,.pj denotes the change of basis to another 
coupled basis \dpd', f) of V' obtained by fusing first b and 
c into /, and then a and / into d, involving a different set 
of intermediate indices {f,^f,rf). The two coupled bases are 
related by a unitary transformation given by the 6-index tensor 
F [e.g., the 6-j symbols for Q = SU(2)] such that 



f - l^K^d )fQe 



/■ 



(13) 



Since Eqs. (11) and (12) represent the same tensor T, the 
degeneracy tensors P and P are related by 



^ahcd 
f 



EiFtJfP: 



bed 



(14) 



More generally, a symmetric tensor T with t indices /j 
(asjUa^ ,ma^), where s = 1, . . . ,r, decomposes as 

{T),,i2...i, = 2_^ Ve^...e|,)ct„^...a,,,ol,^...a,^, 



■ ■in^i ,m^. ...nig 



where the sum is over the intermediate indices 
{ek,ai.^,mei.),k = \, . . . ,t' . The degeneracy tensors P"\'.'.'"l 
contain all the degrees of freedom of T, whereas the structural 
tensors Q"'. .,"', are completely determined by the symmetry. 
Here ei,e2, • ■ • ,e,' are intermediate charges that decorate the 
inner branches of a trivalent tree used to label a basis in the 
space of intertwining operators between the tensor products of 
incoming and outgoing iiTeps. A different choice of tree will 
produce different sets of tensors P and Q, related to P and Q 
by F-moves [11]. 




ef^-^ 



(''.«„) 



FIG. 3. (Color online) A TN for a symmetric state I*) e 
of lattice C (Fig. 1) is expressed as a linear superposition of spin 
networks. The sum runs over the intermediate indices that carry 
charges e and / (shown explicitly) as well as all indices shared 
by two tensors. 

We can now investigate how the TN decomposes if we write 
each of its tensors T in the (^,2) form of Eq. (15) (see Fig. 3). 
For any fixed value of all the charges, the whole TN factorizes 
into two terms. The first one is a TN of degeneracy tensors. 
The second one is a directed graph with edges labeled by irreps 
of Q and vertices labeled by intertwining operators. This is 
nothing other than a spin network [5], a well-known object in 
mathematical physics and, especially, in loop quantum gravity 
[6], where it is used to describe states of quantum geometry. 
Accordingly, a symmetric TN for the state I*) e V®'*' of a 
lattice C oi N sites can be regarded as a linear superposition 
of spin networks with A' open edges. The number of spin 
networks in the linear superposition grows exponentially with 
the size of the TN. The expansion coefficients are given by the 
degeneracy tensors. 

Computationally, the present characterization of a sym- 
metric TN is of interest for several reasons. First of all, it 
allows us to describe a state |vl/)®'^ with specific quantum 
numbers, which are preserved exactly during approximate 
numerical simulations. Let us consider as an example the 
group U(l), with charge n corresponding to particle number 
(n = 0,±1,±2,. . .), and the group SU(2), with charge j corre- 
sponding to the spin (j = 0,1/2,1,3/2, . . .). The symmetric 
TN can be used to describe a state with, for example, 
zero particles (« = 0) and zero spin (j = 0), respectively 
or, more generally, covariant states with any value of « and 
j [8]. 

Second, the (/',2)-decomposition (15) concentrates all 
the degrees of freedom of a symmetric tensor T in the 
degeneracy tensors P, producing a more compact description. 
For instance, for the U(l) and SU(2) groups, an approximation 
of the ground state of the antiferromagnetic Heisenberg spin- j 
chain with a MERA of bond dimension x = 21 requires five 
and thirty-five times fewer parameters than with nonsymmetric 
tensors, respectively [12,13]. 

In addition, the (/',2)-decomposition (15) lowers the cost 
of simulations significantly. Consider the multiplication of two 
tensors (Fig. 4) that is central to most TN algorithms. Cost 
reductions come from two fronts: 

(i) Block-sparse matrices. The most costly step in multiply- 
ing two tensors T' and T" consists of multiplying two matrices 
M' and M" obtained from T' and T". These matrices are of 
the form of Eq. (6), and therefore their multiplication can be 
done blockwise: 



M = M'M" 



0[(M" 



M"") of']. 



(16) 
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'T' t rp \f 



AA = A" 



FIG. 4. (Color online) Product of two symmetric tensors. Only 
the intermediate charges d, e, and / are explicitly shown. Additional 
sums apply to all indices shared by two tensors. The computation 
involves evaluating spin networks. 

(ii) Precomputation. Given a {P , g)-decomposition of tensor 
T , another {P , 2)-decomposition (as required, e.g., to obtain 
matrices M' and M") involves a linear map F: 



r(P). 



(17) 



This map F, of which Eq. (14) is an example, is completely 
determined by the symmetry. In those TN algorithms that 
proceed by repeating a sequence of manipulations, map F 



can be computed once and stored in memory for repeated 
usage. 

A more detailed explanation of algorithmic details, as well 
as practical examples of the gains obtained using invariant 
tensors, is presented in Refs. [12] and [13] for the groups 
U(l) and SU(2), respectively. Reference [4] exploited the U(l) 
symmetry in a 2D MERA calculation that involved tensors 
with up to twelve indices. 

Finally, the connection between symmetric TNs and spin 
networks allows us to import into the context of TN algorithm 
techniques developed to evaluate spin networks in loop 
quantum gravity. Such techniques can be used, for example, 
to compute the linear map F of Eq. (17). Conversely, TN 
algorithms may also prove useful in loop quantum gravity, 
since they allow the efficient manipulation of superpositions 
of an exponentially large number of spin networks, for 
example. 

We thank Ian McCuUoch for continued discussions. Sup- 
port from the Australian Research Council ( ARA, FF066873 1 , 
DP0878830) is acknowledged. 
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3.1 Errata 

The following equations appear erroneously in the publication. They are to be corrected 
as follows. 

The tensors P and Q that appear in Eqs.ll and 12 do not carry degeneracy indices and 
spin indices corresponding to the coupled charges e and /, since these indices are summed 
over in the description. 

In Eq. 11 the components of P and Q read as {Pe'^'^''')aai3bic5d ^^"^ i.Q'e"^'^)mant,ocPd respec- 
tively and the sum is only over different values of charge e. The corrected equation reads, 






(.-t jijkl — / \ t^e )aal3b'rcSd\^e ImaUbOcPdi \^^) 

e 

In Eq. 12 the components of P and Q read as {Pf'"^'^)aai3b-ycSd ^^^ iQf"^''') maUbOcPd respec- 
tively and the sum is only over different values of charge /. The corrected equation 
reads, 

[J' jijkl = / ^[Pf )ctaliblc&d\^f jmaUbOcPd^ l-'-^/ 

/ 

A similar correction holds for Eq. 15 which is a generalization of Eqs.ll and 12. The sum 
is only over different values of the intermediate charges Ci . . . e^/. The corrected equation 
reads, 

\J- )ixi2...it — / J l-* ei...et;JaaT--Q!a^, Wei...e,/J"iai...ma^, ; (,lt)j 

ei...e,/ 



32 Tensor networks and symmetries: Theoretical formalism 



Chapter 4 

Implementation of Abelian symmetries 



In this chapter we speciahze the general formahsm to the case of Abehan symmetries. 
Abehan symmetries appear frequently in the context of lattice models with particles 
(bosons or fermions) as well as those with spins. In the former, they include particle 
number conservation and parity conservation, whereas in the latter they appear as con- 
servation of spin projection. 

The analysis of exploiting an Abelian symmetry is made simple by the fact that the 
structural tensors in this case are trivial. On the other hand, an implementation of an 
Abelian symmetry serves to expose the practical difficulties that are encountered when 
incorporating symmetries into complicated tensor networks. We pay special attention to 
such implementation level concerns. Certain operations in the algorithm depend only on 
the symmetry and not on the components of the tensors involved. We exploit this fact to 
precompute the output of such operations and store their result in memory. This is par- 
ticularly advantageous in an iterative algorithm where tensor components are updated or 
optimized by repeating a set of computations. The runtime cost of the iterative algorithm 
can be significantly reduced by reusing the precomputed results from memory. By making 
use of precomputation we obtained a substantial computational gain from exploiting the 
symmetry in our MATLAB implementation. However, this was achieved at the expense 
of storing potentially large amounts of precomputed data. 

The discussion is conducted in the specific context of U(l) symmetry associated, for 

33 



34 Implementation of Abelian symmetries 

example, with conservation of particle number or of spin projection. We describe how to 
implement elementary tensor manipulations such as permutation and reshape of indices in 
a U(l) symmetric way. We also present a concrete implementation of the U(l) symmetry 
in the context of the MERA. We consider a MERA that is made of U(l) symmetric tensors. 
Then using the U(l) MERA we demonstrate the benefits of including symmetries into 
tensor networks. 
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Tensor network decompositions offer an efficient description of certain many-body states of a lattice system 
and are the basis of a wealth of numerical simulation algorithms. In a recent paper [Phys. Rev. A 82, 050301 
(2010)] we discussed how to incorporate a global internal symmetry, given by a compact, completely reducible 
group Q, into tensor network decompositions and algorithms. Here we specialize to the case of Abelian groups 
and, for concreteness, to a U( 1 ) symmetry, associated, e.g., with particle number conservation. We consider tensor 
networks made of tensors that are invariant (or co variant) under the symmetry, and explain how to decompose and 
manipulate such tensors in order to exploit their symmetry. In numerical calculations, the use of U(l)-symmetric 
tensors allows selection of a specific number of particles, ensures the exact preservation of particle number, 
and significantly reduces computational costs. We illustrate all these points in the context of the multiscale 
entanglement renormalization Ansatz. 
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I. INTRODUCTION 

Tensor networks are becoming increasingly popular as 
a tool to represent wave functions of quantum many-body 
systems. Their success is based on the ability to efficiently 
describe the ground state of a broad class of local Hamiltonians 
on the lattice. Tensor network states are used both as a 
variational Ansatz to numerically approximate ground states 
and as a theoretical framework to characterize and classify 
quantum phases of matter. 

Examples of tensor network states for one-dimensional 
systems include the matrix product state'"^ (MPS), which 
results naturally from both Wilson's numerical renormal- 
ization group'* and White's density-matrix renormalization 
group^"^ (DMRG) and is also used as a basis for simulation 
of time evolution, e.g., with the time evolving block deci- 
mation (TEBD)' " algorithm and variations thereof, often 
collectively referred to as time-dependent DMRG;^ '"^ the 
tree tensor network'^ (TTN), which follows from coarse- 
graining schemes where the spins are blocked hierarchically; 
and the multiscale entanglement renormalization Ansatz^^^^ 
(MERA), which results from a renormalization-group proce- 
dure known as entanglement renormalization.'*-' For two- 
dimensional (2D) lattices there are generalizations of these 
three tensor network states, namely projected entangled 
pair states^"' (PEPS), 2D TTN,^^--'''' and 2D MERA,^4^° 
respectively. As variational Ansdtze, PEPS and 2D MERA 
are particularly interesting since they can be used to address 
large two-dimensional lattices, including systems of frustrated 
spins^''*° and interacting fermions,"*'"^" where Monte Carlo 
techniques fail due to the sign problem. 

A many-body Hamiltonian H may be invariant under 
certain transformations that form a group of symmetries.^ ' The 
symmetry group divides the Hilbert space of the theory into 
symmetry sectors labeled by quantum numbers or conserved 
charges. On a lattice one can distinguish between space 
symmetries, which correspond to some permutation of the 
sites of the lattice, and internal symmetries, which act on the 
vector space of each site. An example of space symmetry is 
invariance under translations by some unit cell, which leads to 
conservation of momentum. An example of internal symmetry 



is SU(2) invariance, e.g., spin isotropy in a quantum spin 
model. An internal symmetry can in turn be global, if it 
transforms the space of each of the lattice sites according to 
the same transformation (e.g., a spin independent rotation); or 
local, if each lattice site is transformed according to a different 
transformation (e.g., a spin dependent rotation), as it is in the 
case of gauge symmetric models. A global internal SU(2) 
symmetry gives rise to conservation of total spin. By targeting 
a specific symmetry sector during a calculation, computational 
costs can often be significantly reduced while explicitly 
preserving the symmetry. It is therefore not surprising that 
symmetries play an important role in numerical approaches. 

In Ref. 52 we described a formalism for incorporating 
global internal symmetries into a generic tensor network 
algorithm. Both Abelian and non-Abelian symmetries were 
considered. The purpose of this paper is to address, at a 
pedagogical level, the implementation of Abelian symmetries 
into tensor networks. We will also discuss several practical 
aspects of the exploitation of Abelian symmetries not covered 
in Ref. 52. For concreteness we will concentrate on the U(l) 
symmetry, but extending our results to any Abelian group is 
straightforward. A similar analysis of non-Abelian groups will 
be considered in Ref. 53. 

In tensor network approaches, the exploitation of global 
internal symmetries has a long history, especially in the context 
of MPSs. Both Abelian and non-Abelian symmetries have 
been thoroughly incorporated into DMRG code and have been 
exploited to obtain computational gains. ^■^''"'•^''^^ Symmetries 
have also been used in more recent proposals to simulate time 
evolution with MPSs.'°-''*'*'''-*^ 

When considering symmetries, it is important to notice that 
an MPS is a trivalent tensor network. That is, in an MPS 
each tensor has at most three indices. The Clebsch-Gordan 
coefficients^' (or coupling coefficients) of a symmetry group 
are also trivalent, and this makes incorporating the symmetry 
into an MPS by considering symmetric tensors particularly 
simple. In contrast, tensor network states with a more elaborate 
network of tensors, such as MERA or PEPS, consist of tensors 
having a larger number of indices. In this case a more general 
formalism is required in order to exploit the symmetry. As 
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explained in Ref. 52, a generic symmetric tensor can be 
decomposed into a degeneracy part, which contains all degrees 
of freedom not determined by symmetry, and a structural 
part, which is completely determined by symmetry and can be 
further decomposed as a trivalent network of Clebsch-Gordan 
coefficients. 

The use of symmetric tensors in more complex tensor 
networks has also been discussed in Refs. 69,70. In particular, 
Ref. 69 has shown that under convenient conditions (injectiv- 
ity), a PEPS that represents a symmetric state can be repre- 
sented with symmetric tensors, generalizing similar results for 
MPSs obtained in Ref. 61. Notice that these studies are not 
concerned with how to decompose symmetric tensors so as to 
computationally protect or exploit the symmetry. On the other 
hand, exploitation of U(l) symmetry for computational gain 
in the context of PEPS was reported in Ref. 70, although no 
implementation details were provided. Finally, several aspects 
of local internal symmetries in tensor network algorithms have 
been addressed in Refs. 71-74. 

The paper is organized in sections as follows. Section II 
contains a review of the tensor network formalism and intro- 
duces the nomenclature and diagrammatical representation of 
tensors used in the rest of the paper. It also describes a set V 
of primitives for manipulating tensor networks, consisting of 
manipulations that involve a single tensor (permutation, fusion, 
and splitting of the indices of a tensor) and matrix operations 
(multiplication and factorization). 

Section III reviews basic notions of representation theory 
of the Abelian group U(l). The action of the group is analyzed 
first on a single vector space, where U(l)-symmetric states 
and U(l)-invariant operators are decomposed in a compact, 
canonical manner. This canonical form allows us to identify the 
degrees of freedom which are not constrained by the symmetry. 
The action of the group is then also analyzed on the tensor 
product of two vector spaces and, finally, on the tensor product 
of a finite number of vector spaces. 

Section IV explains how to incorporate the U(l) symmetry 
into a generic tensor network algorithm, by considering U(l)- 
invariant tensors in a canonical form, and by adapting the 
set V of primitives for manipulating tensor networks. These 
include the multiplication of two U(l)-invariant matrices in 
their canonical form, which is at the core of the computational 
savings obtained by exploiting the symmetry in tensor network 
algorithms. 

Section V illustrates the practical exploitation of the U(l) 
symmetry in a tensor network algorithm by presenting MERA 
calculations of the ground state and low-energy states of 
two quantum spin chain models. Section VI contains some 
conclusions. 

The canonical form offers a more compact description of 
U(l)-invariant tensors, and leads to faster matrix multiplica- 
tions and factorizations. However, there is also an additional 
cost associated with maintaining an invariant tensor in its 
canonical form while reshaping (fusing and/or splitting) its 
indices. In some situations, this cost may offset the benefits of 
using the canonical form. In the Appendix we discuss a scheme 
to lower this additional cost in tensor network algorithms that 
are based on iterating a repeated sequence of transformations. 
This is achieved by identifying, in the manipulation of a 
tensor, operations which only depend on the symmetry. Such 



operations can be precomputed once at the beginning of a 
simulation. Their result, stored in memory, can be reused at 
each iteration of the simulation. The Appendix describes two 
such specific precomputation schemes. 



II. REVIEW: TENSOR NETWORK FORMALISM 

In this section we review background material concerning 
the formalism of tensor networks, without reference to sym- 
metry. We introduce basic definitions and concepts, as well 
as the nomenclature and graphical representation for tensors, 
tensor networks, and their manipulations, that will be used 
throughout the paper. 



A. Tensors 

A tensor f is a multidimensional aiTay of complex numbers 
r,,,,. .;, e C. The rank of tensor T is the number k of indices. 
For instance, a rank-0 tensor {k = 0) is a complex number. 
Similarly, rank-1 {k = \) and rank-2 {k = 2) tensors represent 
vectors and matrices, respectively. The size of an index /, 
denoted |( |, is the number of values that the index takes, i e 
{ 1 ,2, . . . , |/ 1 }. The size of a tensor T , denoted | f | , is the number 
of complex numbers it contains, namely IT"! = |/i| x I/2I x 
■ ■ ■ y. \ik\.\n this paper we will use the hat, ' , to indicate that 
an object is a tensor. We include vectors in this convention, 
writing their components as, e.g., *,, although for simplicity 
we will omit the hat when a vector is written in bra or ket form, 
e.g., |*>. 

It is convenient to use a graphical representation of tensors, 
as introduced in Fig. 1, where a tensor T is depicted as a circle 
(more generally some shape, e.g., a square) and each of its 
indices is represented by a line emerging from it. In order to 
specify which index corresponds to which emerging line, we 
follow the prescription that the lines corresponding to indices 
{ii,i2, ■ ■ ■ 4k} emerge in counterclockwise order. Unless stated 
otherwise, the first index will correspond to the line emerging 
at nine o'clock (or the first line encountered while proceeding 
counterclockwise from nine o'clock). 

Two elementary ways in which a tensor T can be 
transformed are by permuting and reshaping its indices. A 
permutation of indices corresponds to creating a new tensor 
T' from T by simply changing the order in which the indices 
appear, e.g.. 



{T )acb = Ta. 



be- 



(1) 



'"''■^'* 



(b) 



O ,0 -Or 



FIG. 1. (Color online) (a) Graphical representation of a tensor f 
of rank k and components 7)1,,...^. The tensor is represented by a 
shape (circle) with k emerging lines corresponding to the k indices 
i\,ii, . . . ,ik- Notice that the indices emerge in counterclockwise order, 
(b) Graphical representation of tensors with rank A: = 0, 1 , and 2, 
corresponding to a complex number c e C , a vector 1 1;) e C '' ' , and a 
matrix M e C ''■'*'''-', respectively. 



115125-2 



TENSOR NETWORK STATES AND ALGORITHMS IN THE . . . 



PHYSICAL REVIEW B 83, 115 125 (201 1) 



(a) 



•^; 



T c 



(b) 






d =bxc 






FIG. 2. (Color online) Transformations of a tensor: (a) Permuta- 
tion of indices b and c. (b) Fusion of indices b and c into d = b x c; 
splitting of index d = b x c into b and c. 

On the other hand, a tensor T can be reshaped into a new 
tensor T' by "fusing" and/or "splitting" some of its indices. 
For instance, in 



{f'U 



l-abc^ 



b X c. 



(2) 



tensor 7" is obtained from tensor t by fusing indices b e 
{!,... ,\b\] and c e {1, . . . ,|c|} together into a single index d 
of size |c?| = \b\ ■ \c\ that runs over all pairs of values of b and 
c,i.e.,d e {(1,1),(1,2), . . . ,(|fo|,|c| - l),(|fo|,|c|)}, whereas in 



{f')ad, d = bx c. 



(3) 



tensor t is recovered from t' by splitting index d of t' 
back into indices b and c. The permutation and reshaping 
of the indices of a tensor have a straightforward graphical 
representation; see Fig. 2. 

B. Multiplication of two tensors 

Given two matrices R and S with components Rah and 
She, we can multiply them together to obtain a new matrix T, 
T = R ■ S, with components 



7 , RabSbc, 
b 



(4) 



by summing over or contracting index b. The multiplication 
of matrices R and S is represented graphically by connecting 
together the emerging lines of R and S corresponding to the 
contracted index, as shown in Fig. 3(a). 

Matrix multiplication can be generalized to tensors. For 
instance, given tensors R and S with components Rahcd and 



R 



(a) 



(b) 



I a 



R 




r^ 



FIG. 3. (Color online) (a) Graphical representation of the matrix 
multiplication of two matrices R and S into a new matrix T [Eq. (4)]. 
(b) Graphical representation of an example of the contraction of two 
tensors R and S into a new tensor T [Eq. (5)]. 



Scfbh , we can define a tensor t with components fha/d given 
by 



Ihafd 



E^"^ 



bcd^cfbh- 



(5) 



Again the multiplication of two tensors can be graphically 
represented by connecting together the lines corresponding to 
indices that are being contracted [indices b and c in Eq. (5)]; 
see Fig. 3(b). 

The multiplication of two tensors can be broken down into 
a sequence of elementary steps by transforming the tensors 
into matrices, multiplying the matrices together, and then 
transforming the resulting matrix back into a tensor. Next we 
describe these steps for the contraction given in Eq. (5). They 
are illustrated in Fig. 4. 

(1) Permute the indices of tensor R in such a way that the 
indices to be contracted, b and c, appear in the last positions 
and in a given order, e.g., be; similarly, permute the indices of 
S so that the indices to be contracted, again b and c, appear in 
the first positions and in the same order be: 



(R )adbc = Rabcd, 
(S )bcfh = Scfbh ■ 



(6) 



(2) Reshape tensor R' into a matrix R" by fusing into 
a single index u all the indices that are not going to be 
contracted, u = a x d, and into a single index y all indices 
to be contracted, y = b x c. Similarly, reshape tensor S' into 
a matrix 5"' with indices y = b x c and w = f x h. 



(R )«y = (R )adbc, 
(S )yw = (S )bcfh- 



(7) 



(3) Multiply matrices R" and S" to obtain a matrix t", with 
components 



(1)^ 




(f ")„» = j2^R'%iS")y 



= /:^^ i&Z 



(8) 




"K.^y 



T" R" S" 




(4) a 



T' 



d f 





FIG. 4. (Color online) Graphical representations of the five ele- 
mentary steps (l)-(5) into which one can decompose the contraction 
of the tensors of Eq. (5). 
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(4) Reshape matrix t" into a tensor 7" by splitting indices 
u = a X d and w = f x h. 



(T )adfh = (T )i,w 



(9) 



(5) Permute the indices of 7" into the order in which they 
appear in T, 



Thafd = {t ), 



'adfh ■ 



(10) 



We note that breaking down a multiplication of two tensors 
into elementary steps is not necessary — one can simply 
implement the contraction of Eq. (5) as a single process. 
However, it is often more convenient to compose the above 
elementary steps since, for instance, in this way one can 
use existing linear algebra libraries for matrix multiplication. 
In addition, it can be seen that the leading computational 
cost in multiplying two large tensors is not changed when 
decomposing the contraction in the above steps. In Sec. IV I 
this subject will be discussed in more detail for U(l)-invariant 
tensors. 

C. Factorization of a tensor 

A matrix T can be factorized into the product of two (or 
more) matrices in one of several canonical forms. For instance, 
the singular value decomposition 



Tab = 2_^ UacScilVdb = 2_^ UacScVcb 



(11) 



factorizes f into the product of two unitary matrices U and V, 
and a diagonal matrix S with non-negative diagonal elements 
s^. = Sec known as the singular values of T; see Fig. 5(a). 

On the other hand, the eigenvalue or spectral decomposition 
of a square matrix T is of the form 



c,d 



DcdiM-%h = J2 MacK{M-\b, (12) 



where M is an invertible matrix whose columns encode the 
eigenvectors \Xc) of T, 



T\X,.)=K.\X,.), 



(13) 



M~' is the inverse of M, and £> is a diagonal matrix, with the 
eigenvalues A.^. = D„ on its diagonal. Other useful factoriza- 
tions include the LU decomposition, the QR decomposition, 
etc. We refer to any such decomposition generically as a matrix 
factorization. 

A tensor T with more than two indices can be converted 
into a matrix in several ways, by specifying how to join its 
indices into two subsets. After specifying how tensor T is 
to be regarded as a matrix, we can factorize T according 
to any of the above matrix factorizations, as illustrated in 
Fig. 5(b) for a singular value decomposition. This requires first 
permuting and reshaping the indices of T to form a matrix, then 
decomposing the latter, and finally restoring the open indices 
of the resulting matrices into their original form by undoing 
the reshapes and permutations. 



(a) 




\d 



7 id 



- /f. = .\^o^. 



FIG. 5. (Color online) (a) Factorization of a matrix t according 
to a singular value decomposition (11). (b) Factorization of a 
rank-4 tensor T according to one of several possible singular value 
decompositions. 

D. Tensor networiis and tlieir manipulation 

A tensor network A/" is a set of tensors whose indices 
are connected according to a network pattern, e.g.. Fig. 6. 
Given a tensor network N, a single tensor T can be obtained 
by contracting all the indices that connect the tensors in M 
[Fig. 6(b)]. Here, the indices of tensor T correspond to the 
open indices of the tensor network M. We then say that the 
network A/^ is a tensor network decomposition of T . One way 
to obtain T from A/" is through a sequence of contractions 
involving two tensors at a time [Fig. 6(c)]. 

From a tensor network decomposition N for a tensor T , 
another tensor network decomposition for the same tensor T 
can be obtained in many ways. One possibility is to replace 
two tensors in A/" with the tensor resulting from contracting 
them together, as is done in each step of Fig. 6(c). Another way 
is to replace a tensor in M with a decomposition of that tensor 
(e.g., with a singular value decomposition). In this paper, we 
will be concerned with manipulations of a tensor network that, 
as in the case of multiplying two tensors or decomposing a 
tensor, can be broken down into a sequence of operations from 
the following list: 

(1) Permutation of the indices of a tensor, Eq. (1). 

(2) Reshape of the indices of a tensor, Eqs. (2) and (3). 

(3) Multiplication of two matrices, Eq. (4). 



(b) d c 
a h 



d c 





« b 



a' J\f 



FIG. 6. (Color online) (a) Example of a tensor network A^. 

(b) Tensor T of which the tensor network A^ could be a representation. 

(c) Tensor T can be obtained from A^ through a sequence of 
contractions of pairs of tensors. Shading indicates the two tensors 
to be multiplied together at each step. 
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(4) Decomposition of a matrix [e.g., singular value decom- 
position (1 1) or spectral decomposition (12)]. 

These operations constitute a set V oi primitive operations 
for tensor network manipulations (or, at least, for the type 
of manipulations we will be concerned with). In Sec. IV we 
will discuss how this set V of primitive operations can be 
generalized to tensors that are symmetric under the action of 
the group U(l). 

E. Tensor network states for quantum many-body systems 

As mentioned in the Introduction of the paper, tensor 
networks are used as a means to represent the wave function 
of certain quantum many-body systems on a lattice. Let us 
consider a lattice C made of L sites, each described by a 
complex vector space V of dimension d. A generic pure state 
|\]>) e v®^ of C can always be expanded as 



l*> = 



E 



*,W-2-'J'l>l''2> 



\iL) 



(14) 



where i^ = \, . . . ,d labels a basis |(s> of V for site s & C. 
Tensor *, with components *l',,,2...,:^, contains d^ complex 
coefficients. This is a number that grows exponentially with 
the size L of the lattice. Thus the representation of a generic 
pure state I*) e V®^ is inefficient. However, it turns out that 
an ej5^c/e«f representation oi certain pure states can be obtained 
by expressing tensor * in terms of a tensor network. 

Figure 7 shows several popular tensor network decompo- 
sitions used to approximately describe the ground states of 
local Hamiltonians H of lattice models in one or two spatial 
dimensions. The open indices of each of these tensor networks 
correspond to the indices ii,i2, ■ ■ ■ Jl of tensor *. Notice that 
all the tensor networks of Fig. 7 contain 0(L) tensors. If p 
is the rank of the tensors in one of these tensor networks, 
and X is the size of their indices, then the tensor network 
depends on 0(Lx'') complex coefficients. For a fixed value 
of X this number grows linearly in L, and not exponentially. 



(a) 



rrmrrrnrnrm 






FIG. 7. (Color online) Examples of tensor network states for ID 
systems: (a) matrix product state (MPS), (b) tree tensor network 
(TTN), (c) multiscale entanglement renormalization A«.safz (MERA). 
Examples of tensor network states for 2D systems: (d) projected 
entangled-pair state PEPS, (e) 2D TTN (2D MERA not depicted). 



It therefore does indeed offer an efficient description of the 
pure state |*) e V®^ that it represents. Of course only a 
subset of pure states can be decomposed in this way. Such 
states, often referred to as tensor network states, are used as 
variational j4«5fl7ze, with the 0{Lx'') complex coefficients as 
the variational parameters. 

Given a tensor network state, a variety of algorithms (see, 
e.g., Refs. 4-50) are used for tasks such as (i) computation 
of the expectation value (*|o|*) of a local observable 
o, (ii) optimization of the variational parameters so as to 
minimize the expectation value of the energy (*|7?|*), or 



(iii) simulation of time evolution, e.g.. 



'|*>. These tasks 



are accomplished by manipulating tensor networks. 

On most occasions, all required manipulations can be 
reduced to a sequence of primitive operations in the set V 
introduced in Sec. II D. Thus in order to adapt the tensor 
network algorithms of, e.g., Refs. 4-50 to the presence of 
a symmetry, we only need to modify the set V of primitive 
tensor network operations. This will be done in Sec. IV. 

F. Tensors as linear maps 

A tensor can be used to define a linear map between vector 
spaces in the following way. First, notice that an index ( can 
be used to label a basis {\i)] of a complex vector space V^'^ = 
C''' of dimension |/|. On the other hand, given a tensor T 
of rank k, we can attach a direction "in" or "out" to each 
index iiM, ■ ■ ■ Jk- This direction divides the indices of T into 
the subset / of incoming indices and the subset O of outgoing 
indices. We can then build input and output vector spaces given 
by the tensor product of the spaces of incoming and outgoing 
indices, 



ylinl 



I yl';] yloutl 



tUi] 



(15) 



i;e/ 



heO 



and use tensor t to define a linear map between V^'"! and 
y[out] pqj. instance, if a rank-3 tensor Tah^. has one incoming 
index c € I and two outgoing indices a,b e O, then it defines 
a linear map t : Vf'l -^ Vf"' (g) V"'' given by 



t=J2t,tAa)\b){c\. 



(16) 



a,b.( 



Graphically, we denote the direction of an index by means of 
an arrow; see Fig. 8(a). 



(a) >|C (b) 





d c 



a b 



FIG. 8. (Color online) (a) Tensor f with one incoming index and 
two outgoing indices, denoted by incoming and outgoing arrows, 
respectively [Eq. (16)]. (b) A tensor network A^ with directed links 
can be interpreted as a linear map between incoming and outgoing 
spaces (of the incoming and outgoing indices) obtained by composing 
the linear maps associated with each of the tensors in A^. 
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By decorating the lines of a tensor network M with arrows 
[Fig. 8(b)], this can be regarded as a composition of linear 
maps — namely, one linear map for each tensor in M . While 
arrows might be of limited relevance in the absence of a 
symmetry, they will play an important role when we consider 
symmetric tensors since they specify how the group acts on 
each index of a given tensor. 

III. REVIEW: REPRESENTATION THEORY 
OF THE GROUP U(l) 

In this section we review basic background material 
concerning the representation theory of the group U(l). We 
first consider the action of U(l) on a vector space V, which 
decomposes into the direct sum of (possibly degenerate) 
irreducible representations. We then consider vectors of V 
that are symmetric (invariant or covariant) under the action of 
U(l), as well as linear operators that are U(l) invariant. Then 
we consider the action of U(l) on the tensor product of two 
vector spaces, and its generalization to the tensor product of 
an arbitrary number of vector spaces. 

A. Decomposition into direct sum of irreducible representations 

Let V be a finite-dimensional space and let ^ e [0,2:/r) label 
a set of linear transformations W, 



if. 



"Nif-.y 



V, (17) 

that are a unitary representation of the group U(l). That is, 

I, V^€[0,27r), (18) 



W^W'^ 



W^W^^ 



'^9^ ^K = ^V^ ^^. = '^9^+^^\^, ' V ip, ,^2 € [0,2:r). 

(19) 

Then V decomposes as the direct sum of (possibly degenerate) 
one-dimensional irreducible representations (or irreps) of 
U(l), 



v = 0v„. 



(20) 



It then follows from Eq. (22) that 

WJnt„) = e-'"'f\nt„), W cp e [0,2n). 



(24) 



The dual basis { (nf„ | } is transformed by the dual representation 
of U(l), with elements W^, as 



intJW. 



■ cp' 

^""(nt,, 



V ^ e [0,2;t). 



(25) 



Example 1. Consider a two-dimensional space V that 
decomposes as V = Vo ® Vi , where the irreps n = and n = 
1 are nondegenerate (i.e., do = di = 1). Then the orthogonal 
vectors {\n = 0,fo = l>,|n = i,h = 1>} form a basis of V. In 
column vector notation, 



\n = 0,to = 1> 



\n = l,fi = 1>, (26) 



the particle number operator n and transformation W^ read 




1 



W,„ 











(27) 



Example 2. Consider a four-dimensional space V that 
decomposes as V = Vq ® Vi ® V2, where do = d2 = 1 and 
di = 2, so that now irrep « = 1 is twofold degenerate. Let 
{\n = l,ti = l>,|n = l,fi =2)} form a basis of Vi . In column 
vector notation. 



/1\ 




/o\ 



1 



\n=0,to= 1> 



l,?i=2>, 



1 


VO/ 
/o\ 




Vi/ 



\n= l,ti = I) 



(28) 



2,?2 = 1) 



(29) 



the particle number operator n and transformation W,p read 



where V„ is a subspace of dimension d„ , made of d„ copies 
of an irrep of U(l) with charge n e Z. We say that irrep n 
is d„-iold degenerate and that V„ is the degeneracy space. 
For concreteness, in this paper we identify the integer charge 
n as labeling the number of particles (another frequent 
identification is with the z component of the spin, in which case 
semi-integer numbers may be considered). The representation 
of group U(l) is generated by the paiticle number operator ft. 



= ^nP„, P„ = ^ \ntn)(ntn\, 



(21) 



',,=1 



where P„ is a projector onto the subspace V„ of particle number 
n, and the vectors \nt„). 



h\nt,j) = n\nt„), t„ = I, . . . ,d„. 



(22) 



are an orthonormal basis of V„. In terms of n, the transforma- 
tions W,p read 



W^ = e-'"^ 



(23) 



/O 0\ 




/I 








\ 


10 
10 


, w = 






e-'f 





e-'f 






^0 2y 




u 








e-'^f f 



(30) 



B. Symmetric states and operators 

In this work we are interested in states and operators that 
have a simple transformation rule under the action of U(l). A 
pure state |*> e V is symmetric if it transforms as 



IV^|*> = e-"'*'|*>, V^e[0,2;T). 



(31) 



The case « = corresponds to an invariant state, l^,,|*) = 
|^>, which transforms trivially under U(l), whereas for n 7^ 
the state is covariant, with | *> being multiplied by a nontrivial 
phase e~™'f . Notice that a symmetric state I*) is an eigenstate 
of h: that is, it has a well-defined particle number n. |*> can 
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thus be expanded in terms of a basis of the relevant subspace 

dn 

«|*> =„!*>, |*>=;^(*„),„K,>, (32) 

t„=\ 

where we have introduced a charge label „ on the state 
coefficients of |*> so that we can explicitly associate each 
coefficient (*„),„ with its corresponding basis vector |nf„>. 

A linear operator f : V — >• V is invariant if it commutes 
with the generator h, 

[f ,n] = 0, (33) 

or equivalently if it commutes with the action of the group, 

W^fwl = f, V^e[0,2;T). (34) 

It follows that T decomposes as (Schur's lemma) 

r = 0f,„ (35) 

n 

where T„ is a d„ x d„ matrix that acts on the subspace V„ in 
Eq. (20). 

Notice that the operator T in Eq. (35) transforms vectors 
with a well-defined particle number n into vectors with 
the same particle number. That is, U(l)-invariant operators 
conserve particle number. 

Example 1 revisited. In example 1 above, symmetric vectors 
must be proportional to either \n = 0,fo = 1> or \n = l,fi = 
1). An invariant operator 7" = Tb ® Ti is of the form 



ttO 









aQ,ai e 



(36) 



Example 2 revisited. In example 2 above, a symmetric 
vector I * > must be of the form 



l*> = 



/ao\ 





l*> = 



0-1 

Pi 



or |*> = 



/0\ 



V«2/ 



/ao 








o\ 





a\ 


/Ji 








n 


3i 





U 








0^2 / 



(37) 

whereao,ai,ySi,a2 € C . An invariant operator T = Tq ® Ti ® 
72 is of the form 



(38) 



where fi corresponds to the 2x2 central block and 
ao,ai,jSi,)/i,(5i,a2 e C 

The above examples illustrate that the symmetry imposes 
constraints on vectors and operators. By using an eigenbasis 
{|nf„>} of the particle number operator «, these constraints 
imply the presence of the zeros in Eqs. (36)-(38). Thus 
a reduced number of complex coefficients is required in 
order to describe U(l)-symmetric vectors and operators. As 
we will discuss in Sec. IV, performing manipulations on 



symmetric tensors can also result in a significant reduction 
in computational costs. 

C. Tensor product of two representations 

Let V*'*' and V'*' be two spaces that carry representations 
of U(l), as generated by particle number operators n^'** and 
n'*', and let 



T(A) 



evif, 



V(S) 



e^if 



(39) 



be their decompositions as a direct sum of (possibly degen- 
erate) irreps. Let us also consider the action of U(l) on the 
tensor product V*'*^* = V*'*' ® V*^* as generated by the total 
particle number operator 



f^iAB) 



i^-^^Ol + IOn'*', 



that is, implemented by unitary transformations 



(40) 



(41) 



The space V^-**' also decomposes as the direct sum of 
(possibly degenerate) iiTeps, 



V(AB) 



e^r- 



(42) 



Here the subspace V,J'**\ with total particle number hab, 
corresponds to the direct sum of all products of subspaces 



Vj;^* and V,5f * such that nA+nB = hab, 






e 



V(A), 

"A 



V(B)_ 



(43) 



'U.ibU. 



For each subspace V,*'**' in Eq. (42) we introduce a coupled 
basis{|nAB?«,,J}, 



«*'**' |nAB?«,,B) = nAB\nABtnA 



(44) 



where each vector InAB^/us) corresponds to the tensor product 
IfiAttiA'^nBtne) = \nAtnA) ® InBtng) of a uniquc pair of vectors 
\nAt„J and |«Bf„„>, with«^ + n^ = n^^. Lettable Tf"^*^, with 
components 



T, 



fuse 



[n ABtn,^s\n AtnA^nBtn^) 



(45) 



encode this one-to-one correspondence. Notice that each 
component of T*^^'*"^ is either a or a 1. Then 



nAt,nniit„g 
X \nAtn/,nBt„X 



(46) 



For later reference (see the Appendix), we notice that T^"'*'^ 
can be decomposed into two pieces. The first piece expresses a 
basis { |n^?„,;nBf„j>} of V^'^^Hn terms of thebasis{|«4f„,>} of 
V''*' and the basis {|«b?«b>} of V*^"®'. This assignment occurs as 
in the absence of the symmetry, where one creates a composed 
index d = b x chy running, for example, fast over index c and 
slowly over index b as in Eq. (2). Note that this procedure does 
not always lead to the set { |n/i?„ , ; n^fng > } being ordered such 
that states corresponding to the same total particle number 
hab = nA+ns are adjacent to each other within the set. This 
ordering is achieved by the second piece: a permutation of 
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basis elements that reorganizes them according to their total 
particle number «ab, so that they are identified in a one-to-one 
correspondence with the coupled states {\nABt,na)}- 

Finally, the product basis can be expressed in terms of the 
coupled basis 



|nAf«A;«B'n«) 



V~^ ^ split 



X InABtn^s)' 



(47) 



with 



T, 



Split 



T, 



fuse 



Example 3. Consider the case where both V*'** and V**' 





correspond to the space of example 1, that is, V*'*' — "^^^ 



l(A) 



and V^^) = 



t(B) , 



AB) 



where 



'0 ' 



/l''\ Vo<*>, and 



all have dimension 1. Then V*'*^* corresponds to the 



space in example 2, namely 

y(AB) ~ y(A) ^ y(B) 



V{^') 



V, 



(AB) , 



V, 



(AB) , 



where 



AAB) 



^(AB) ^ 
'0 — 



AA) ^ 



C' 



V. 



7(B) 



(AB) 



= {yr ® V,*''*) ® (v<^* ^ 



vrO' 



V. 



(AB) 



= v, 



(A), 



7(B) 



(49) 



(50) 



(51) 



(52) 



The coupled basis {|«ABf«,,B)} reads 



|«AB = 0,ro = 1> = l«A = 0,fo = 1> (8) |«B = OJq = 1>, 
Iwab = IJi = 1) = l«A = 0,fo = 1> (8) |mb = l,fi = 1>, 
IriAB = iA = 2) = Ima = l,fi = 1> (8) |«b = 0,fo = 1>, 
[riAB = 2,t2 = 1> = |ma = 1,^1 = 1> (8) Imb = l,fi = 1>, 

(53) 

where we emphasize that the degeneracy index t,,^^ takes two 
possible values for hab = l,i.e.,fi e {1,2}, since there are two 
states \nAt„J (8 InB^ng) with ha + ns = 1. The components 
T,^"f „ t ^n t of the tensor T^"^'' that encodes this change 
of basis are all zero except for 



T, 



01.01^01 



T, 



01,11^11 



T 



11,01^12 



T 



fuse 
11,11^21 



1. 



D. Lattice models with U(l) symmetry 
The action of U(l) on the threefold tensor product, 

y(ABC) ~ y(A) ^ y(B) ^ y(C)^ 

as generated by the total particle number operator, 

fl(ABC) ^ ^(A) ^ I ^ J _^ J ^ ^(B) (g) I + I (g) I (g) fi(C) 



(54) 



induces a decomposition 



y(ABC) ~ rr\ y(ABC) 



(56) 



in terms of irreps Vj'**''* which we can now relate to V*'*', 
V„^*\ and V„*''*. For example, we can consider first the product 
V(^«) = v/> (8 Vi^' and then the product Vi'**'^> = Vi'*^> (8 

nAB «/\ "B J^^ "/IBC f^AB 

V,^''', using a different table T^"^*^ at each step to relate the 
coupled basis to the product basis as discussed in the previous 
section. Similarly we could consider the action of U( 1 ) on four 
tensor products, and so on. 

In particular we will be interested in a lattice C made of 
L sites with vector space V®^, where for simplicity we will 
assume that each site ^ e £ is described by the same finite- 
dimensional vector space V (see Sec. HE). Given a paiticle 
number operator n defined on each site, we can consider the 
action of U(l) generated by the total particle number operator 



N^^n^'\ 



which corresponds to unitary transformations 



<1 



■iN(p _ 



The tensor product space V®^ decomposes as 

y®L S Va, 



(57) 



(58) 



(59) 



and we denote by (IA'^a;)} the particle number basis in V®^. 
We say that a lattice model is U(l) symmetric if its 
Hamiltonian H : Y ^ Y commutes with the action of the 
group. That is. 



[H,N] =0, 



or equivalently 



iW^f'-HiWh' 



H, W(pe [0,2jr). 



(60) 



(61) 



One example of a U(l)-symmetric model is the hard-core 
Bose-Hubbard model, with Hamiltonian 

L L 

^HCBH = ^(flJa.,+1 + a.a]+i + yn,n,+i) - fJ.'^n,, 

,v=l s-l 

(62) 

where we consider periodic boundary conditions (by identify- 
ing sites L + 1 and 1), and a] and a^ are hard-core bosonic 
creation and annihilation operators, respectively. In terms of 
the basis introduced in example 1 these operators are defined 
as 



1 




n = fl'fl 




1 



To see that Hhcbh commutes with the action of the group, we 
first observe that for two sites 



[a\a2 + fljfli,«i + «2] = 0, 
(55) from which it readily follows that [Hucbh,N] = 0. 



(63) 
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Notice that the chemical potential term —fi ^^. Hj = —fiN 
also commutes with the rest of the Hamiltonian. The ground 
state l*^^) of ^HCBH in a particular subspace Yn or particle 
number sector can be turned into the absolute ground state by 
tuning the chemical potential //. This fact can be used to find 
the ground state | *^^ > of any particle number sector through 
an algorithm which can only minimize the expectation value 
of ^HCBH- However, we will later see that the use of symmetric 
tensors in the context of tensor network states will allow us to 
directly minimize the expectation value of ^hcbh in a given 
particle number sector by restricting the search to states 



dfi 



l*w> = ^(*^klA^f^> 



(64) 



'«=i 



with the desired particle number A^. 
Finally, by making the identifications 



11 — a~ CTv + ' CTy 

n = — I — '-, a = 



2 2 

where a^,ay,a- are the Pauli matrices 



1 



-/ 



"'^>i 0' ">^l/ oi' "-^"vo -1 



1 



(65) 



one can map ^hcbh to the spin-| XXZ quantum spin chain 
Hxxz - E (^i^'^i^^" + ^'-^r" + Aa*''a<'+')), (66) 

s=l 

where we have ignored terms proportional to N and set A = 
y/4. In particular, for A = we obtain the quantum XX spin 
chain 

H,, ^ J2 i^^'^^^'' + ^f^^^'^)^ (67) 

.v=l 

and for y = 1 , the quantum Heisenberg spin chain 

Hxxx - J2 ('^i^'^^.r" + ^y'^y^'' + ^^'^^^'')- (68) 

i=i 

In Sec. V, the quantum spin models (67) and (68) will be used 
to benchmark the performance increase resulting from the use 
of symmetries in tensor networks algorithms. 

IV. TENSOR NETWORKS WITH U(l) SYMMETRY 

In this section we consider U(l)-symmetric tensors and ten- 
sor networks. We explain how to decompose U(l)-symmetric 
tensors in a compact, canonical form that exploits their 
symmetry. We then discuss how to adapt the set V of primitives 
for tensor network manipulations in order to work in this form. 
We also analyze how working in the canonical form affects 
computational costs. 

A. U(l)-symmetric tensors 

Let r be a rank-A: tensor with components T),,,...,^. As in 
Sec. II F, we regard tensor f as a linear map between the 
vector spaces V''"! and Vf™" [Eq. (15)]. This implies that 



each index is either an incoming or outgoing index. On each 
space yf''', associated with index (;, we introduce a particle 
number operator n*'* that generates a unitary representation 
of U(l) given by matrices W^ = e""'"'*', (p e [0,2jt). In the 
following, we use W'''* to denote the complex conjugate of 



V 



Let us consider the action of U(l) on the space 



given by 



where 



X 



(1) , 



' X'^ ' 



X<P ' 



X 



(I) 



W^^* if /, e /, 
W^'^ if i, € O. 



(69) 



(70) 



(71) 



That is, X^'' acts differently depending on whether index // of 
tensor T is an incoming or outgoing index. We then say that 
tensor T, with components Ti^i,...ii., is U(l) invariant if it is 
invariant under the transformation of Eq. (70), 

'1,!2, ■■■■<■* 

for all (p e [0,2jr). This is depicted in Fig. 9. 

Example 4. A U(l)-invariant vector |*> — that is, a vector 
with «|>I') =0 and components (*„=o)fo in the subspace 
V„=o which corresponds to vanishing particle number « = 
[cf. Eq. (32)]— fulfills 

(*„=o),„' = ^(l^^),„7o(*«=o)ro. V ,p e [0,2:r), (73) 



in accordance with Eq. (31), as shown in Fig. 9(a). 
Example 5. A U(l)-invariant matrix T (35) fulfills 



faV = ^(lV^)«'a(W;),yfef„i (74) 

a.h 

= Y.{W^)a'afab{Wl)w, V^€[0,27r), (75) 
a,b 

in accordance with Eq. (34) [see Fig. 9(b)]. 



o 



W„ 



I 



(a) 




FIG. 9. (Color online) (a) Constraint fulfilled by a U(l)-invariant 
vector. The only allowed particle number on the single index is n = 0. 

(b) Constraint fulfilled by a U(l)-invariant matrix. It follows from 
Schur's lemma that the matrix is block diagonal in particle number. 

(c) Constraint fulfilled by a rank-3 tensor with one incoming index 
and two outgoing indices. 
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Example 6. Tensor t in Eq. (16), with components tube, 
where a and b are outgoing indices and c is an incoming index, 
is U(l) invariant if 

t'...' = E «o„ J^f )..(^r)./"- (76) 

= EWlJ^r)..^-(^r).. (77) 

a,b,c 

for all (p &[0,2tt) [see Fig. 9(c)]. 

Further, we say that a tensor Q with components Qj^j^-.i^ 
is U(l) covariant if under the transformation of Eq. (70) it 
acquires a non trivial phase e~'"*', 

i\,i2,-.ik 

(78) 

for all (p e [0,2n). 

Example 7. A U(l)-covariant vector |*> — that is, one 
which satisfies n|*>=n|<I'> for some n # 0, and has 
nonzero components (*„),„ only in the relevant subspace V,, 
[cf. Eq. (32)]— fulfills 

^(W'^),;, /„(*„),„ = ^-"'^*„),;, , V ^ e [0,27r), (79) 

tn 

in accordance with Eq. (31). (See also Fig. 10.) 

Notice that we can describe the rank-^ covariant ten- 
sor Q above by a rank-(A: +1) invariant tensor T with 
components 






U.i]i2—it 



1. 



(80) 



This is built from Q by adding an extra incoming index / , where 
the index / has a fixed particle number n and no degeneracy 
(i.e., / is associated to a trivial space V''^ = C). We refer to 
both invariant and covariant tensors as symmetric tensors. By 
using the above construction, in this work we will represent all 
U(l)-symmetric tensors by means of U(l)-invariant tensors. 
In particular, we represent the nontrivial components (*„),„ of 
the covariant vector |*„> in Eqs. (31) and (32) as an invariant 
matrix T of size |?„| x 1 with components T,^^i = (^„), . 
Consequently, from now on we will mostly consider only 
invariant tensors. 



Y 



^) 



4 = '-'■' I 



O (*«) = (*») 



(a) 



W^ 



(b) 



FIG. 10. (Color online) (a) U(l)-covariant vector I*), with some 
nonvanishing particle number n ^0. Under the action of U(l) on its 
index, the covariant vector I'l') acquires a phase e""'*" [Eq. (79)]. 
(b) The U(l)-covariant vector |*), with components (*„),„, can 
be represented by a U(l)-invariant matrix T with components 
IJi, = (ip,,),! , where / is a trivial index (|! | = 1) with charge n and is 
decorated by the opposite arrow to I'l . 



B. Canonical form for U(l)-invariant tensors 

Let us now write a tensor T" in a particle number basis on 
each factor space in Eq. (69). That is, each index /i, (2, • • •, h is 
decomposed into a particle number index n and a degeneracy 
index t„, ii = («i,f„,), (2 = («2,?«,), • • -, h = (nk,tnt), and 



^i]h---k — V-'"in2'"'U/f,^ l„^'-t„ 



(81) 



Here, for each set of particle numbers «i ,«2, ■ ■ ■ ."i , we regard 
f,„„,...„j as a tensor with components (f,,, „,...„(, ),„_,„,. ..,„^. Let 
A^in and A'out denote the sum of particle numbers corresponding 
to incoming and outgoing indices. 



Mn^X!"'' ^oyA=Yl, 



ni. 



(82) 



niel 



iiisO 



The condition for a nonvanishing tensor of the form tn^n-,---nt 
to be invariant under U(l), Eq. (70), is simply that the sum of 
incoming particle numbers equals the sum of outgoing particle 
numbers. Therefore a U(l)-invariant tensor T satisfies 



t= ^ t 



niJi2---iu^Nni,N^i 



(83) 



[We use the direct sum symbol to denote that the different 
tensors f,,,,,,.. „; are supported on orthonormal subspaces of the 
tensor product space of Eq. (69).] In components, the above 
expression reads 



T 



(Tntm-ntji ,^^^,„, Sf, 



(84) 



Here, Sn^^.n^^i implements particle number conservation: if 
A^i„ ^ NoM, then all components of 7),,,,,...,^ must vanish. This 
generalizes the block structure of U(l)-invariant matrices in 
Eq. (35) (where T„n is denoted T„) to tensors of arbitrary rank 
k. The canonical decomposition in Eq. (83) is important, in 
that it allows us to identify the degrees of freedom of tensor T 
that are not determined by the symmetry. Expressing tensor T 



in terms of the tensors T„, 



with Nir 



N„ut ensures that 



we store t in the most compact way possible. 

Notice that the canonical form of Eq. (83) is a particular 
case of the canonical form presented in Eq. (15) of Ref. 52 for 
more general (possibly non-Abelian) symmetry groups. There, 
a symmetric tensor was decomposed into degeneracy tensors 
[analogous to tensors T„^„^...„i_ in Eq. (83)] and structural 
tensors [generalizing the term 5/Vi„,Ar„„, in Eq. (83)] which can in 
general be expanded as a trivalent network of Clebsch-Gordan 
(or coupling) coefficients of the symmetry group. In the case of 
non-Abelian groups, where some irreps have dimension larger 
than 1 , the structural tensors are highly nontrivial. However, for 
the group U( 1 ) discussed in this paper (as for any other Abelian 
group) all irreps are one dimensional and the structural tensors 
are always reduced to a simple expression such as S/^.^^n„, 
in Eq. (83). (Nevertheless, in the Appendix we will resort 
to a more elaborate decomposition of the structural tensors 
in order to better exploit the presence of symmetry in those 
tensor network algorithms based on iterating a fixed sequence 
of manipulations.) 

C. U(l)-symmetric tensor networks 

In Sec. II F we saw that a tensor network Af where each line 
has a direction (represented with an arrow) can be interpreted 
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FIG. 11. (Color online) A tensor network M made of U(l)- 
invariant tensors represents a U(I)-invariant tensor T . This is seen 
by means of two equalities. The first equality is obtained by inserting 
resolutions of the identity I = W^ ly J on each index connecting two 
tensors in A^. The second equality follows from the fact that each 
tensor in A^ is U(l) invariant. 



as a collection of linear maps composed into a single linear 
map T of which A/^ is a tensor network decomposition. 
By introducing a particle number operator on the vector 
space associated to each line of A/", we can define a unitary 
representation of U(l) on each index of each tensor in M. 
Then we say that A/" is a U(l)-invariant tensor network if all 
its tensors are U(l) invariant. Notice that, by construction, if 
A/^ is a U(l)-invariant tensor network, then the resulting linear 
map T is also U(l) invariant. This is illustrated in Fig. 11. 

More generally, we can consider a U(l)-symmetric tensor 
network, made of tensors that are U(l) symmetric (that 
is, either invariant or covariant). Recall, however, that any 
covariant tensor can be represented as an invariant tensor by 
adding an extra index (80). Therefore without loss of generality 
we can restrict our attention to invariant tensor networks. 



D. Tensor network states and algorithms with U(l) symmetry 

As discussed in Sec. II E, a tensor network M can be used 
to describe certain pure states I*) e V®"^ of a lattice C. If A/" 
is a U(l)-symmetric tensor network then it will describe a pure 
state I*) that has a well-defined total particle number A^. That 
is, a U(l)-symmetric pure state 



N\'i')=N\-^), e-'™'^|*> =e-'™*'|*> 



-\N(p\ 



(85) 



In this way we can obtain a more refined version of popular 
tensor network states such as MPS, TTN, MERA, PEPS, 
etc. As a variational Ansatz, a symmetric tensor network 
state is more constrained than a regular tensor network state, 
and consequently it can represent fewer states I*) e V®^. 
However, it also depends on fewer parameters. This implies 
a more economical description, as well as the possibility of 
reducing computational costs during its manipulation. 

The rest of this section is devoted to explaining how one 
can achieve a reduction in computational costs. This is based 
on storing and manipulating U( 1 )-invariant tensors expressed 
in the canonical form of Eqs. (83) and (84). We next explain 
how to adapt the set V of four primitive operations for the 
tensor network manipulations discussed in Sec. II D, namely, 
permutation and reshaping of indices, matrix multiplication, 
and factorization. 



E. Permutation of indices 

Given a U(l)-invariant tensor T expressed in the canonical 
form of Eqs. (83) and (84), permuting two of its indices is 
straightforward. It is achieved by swapping the position of 
the two particle numbers of T„,„^...„^ involved, and also the 
corresponding degeneracy indices. For instance, if the rank-3 
tensor T of Eq. (16) is U(l) invariant and has components 



labc — {^nAniinc), , , "n,i+ns,nc 
''"A'"a'"c 



(86) 



when expressed in the particles number basis a = {nA,tnf,)^ 
b = {nB,tng), c = {nc,t„c), then tensor T' of Eq. (1), obtained 
from T by permuting the last two indices, has components 



where 



(j )ach — (^nAncnu), , , "nA+nB,nc-: (°') 



[.^nAncneJi t t ~ VnA'iBnc), , , ■ (88) 

" I- I" 'itA'nc'i'lS ' '"a'"b'"C 



Notice that since we only need to permute the components 
of those Tn^nenc such that iiA+riB = nc, implementing the 
permutation of indices requires less computation time than 
a regular index permutation. This is shown in Fig. 12, 
corresponding to a permutation of indices using MATLAB. 

F. Reshaping of indices 

The indices of a U(l)-invariant tensor can be reshaped 
(fused or split) in a similar manner to those of a regular 
tensor. However, maintaining the convenient canonical form 
of Eqs. (83) and (84) requires additional steps. Two adjacent 
indices can be fused together using the table T'"'*'^ of Eq. (45), 
which is a sparse tensor made of 1 's and O's. Similarly an index 
can be split into two adjacent indices by using its inverse, the 
sparse tensor T'p'" of Eq. (48). 

Example 8. Let us consider again the rank-3 tensor T of 
Eq. (16) with components given by Eq. (86), where a and b 
are outgoing indices and c is an incoming index. We can fuse 
outgoing index b and incoming index c into an (e.g., incoming) 
index d, obtaining a new tensor T" with components 



(T')ad = {Z^,„J S„ 



(89) 



where no = —ng + ric- (The sign in front of rig comes from 
the fact that d is an incoming index and b is an outgoing index.) 
The components of 7" are in one-to-one correspondence with 
those of T and follow from the transformation 



VnAno)t„^t„g ~ 2^ V^"^"''"c^'„,,'„^'„c- 



nB-t„u.nc,t„c 



xT, 



fuse 



(90) 



where only the case n^ = «d needs to be considered. To 
complete the example, let us assume that the index a is 
described by the vector space V*'** = Vq ® Vj ® V2 with 
degeneracies ^0 = i,di =2, and d2 = l; index b is described 
by a vector space V^^-* = V_i ® Vq without degeneracies, i.e., 
d-i = do = 1; and index c is described by a vector space 
yCC) ^ Yo Yj ^jgQ without degeneracies, d-i = do = 1. 
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FIG. 12. (Color online) Computation times (in seconds) required 
to permute and fuse two indices of a rarLk-4 tensor T, as a function 
of the size of the indices. All four indices of T have the same size, 
5d, and therefore the tensor contains \T\ = 5''rf'* coefficients. The 
figures compare the time required to perform these operations using 
a regular tensor and a U(l)-invariant tensor, where in the second 
case each index contains five different values of the particle number 
n (each with degeneracy d) and the canonical form of Eqs. (83) 
and (84) is used. The upper figure shows the time required to 
permute two indices: For large d, exploiting the symmetry of a 
U(l)-invariant tensor by using the canonical form results in shorter 
computation times. The lower figure shows the time required to 
fuse two adjacent indices. In this case, maintaining the canonical 
form requires more computation time. Notice that in both figures 
the asymptotic cost scales as 0(d'*), or the size of T , since this is the 
number of coefficients which need to be rearranged. We note that the 
fixed-cost overheads associated with symmetric manipulations could 
potentially vary substantially with choice of programming language, 
compiler, and machine architecture. The results given here show 
the performance of the authors' MATLAB implementation of U(l) 
symmetry. 

Then V^^^ = V<^> ® V'"^' (and in this example, also V<^' = 
V'-^*) and Eq. (90) amounts to 

(^o'o)ii = (^ooo)iii , (ri'i)ii = (^101)111 , 
(^i'i)i2 = (^101)211 ' (^n)2i = (^i(-i)o)in . 

(^l'l)22 = (^l(-l)o)211 ' (^22)11 = (72(-l)l)iil ' 

where we notice that tensor T' is a matrix as in Eq. (38). 
Similariy, we can split incoming index d of tensor 7" back into 



outgoing index b and incoming index c of tensor f according 
to 



no •',,,: 



xT, 



split 



(91) 
Mfl and tiA + 



which, again, is nontrivial only for —hb + r 
riB = ric- 

This example illustrates that fusing and splitting indices 
while maintaining the canonical form of Eqs. (83) and (84) 
requires more work than reshaping regular indices. Indeed, 
after taking indices b and c into d = b x chy listing all pairs 
of values b x c,v/e still need to reorganize the resulting basis 
elements according to their particle number no. Although this 
can be done by following the simple table given by T^"'*'^, it may 
add significantly to the overall computational cost associated 
with reshaping a tensor. For instance. Fig. 12 shows that fusing 
indices of invariant tensors can be more expensive than fusing 
indices of regular tensors. 

G. Multiplication of two matrices 

By permuting and reshaping the indices of a U(l)-invariant 
tensor, we can convert it into a U(l)-invariant matrix T = 
0„„' ^nn'S^,,,., or simply 

f = 0T'„, (92) 

n 

where t^ = t„„ . In components, matrix T reads 

(n,i = (f„),„,;,, (93) 

where a = {n,t„) and b = in,t]^). In particular, similar to the 
discussion in Sec. II B for regular tensors, the multiplication of 
two tensors invariant under the action of U(l) can be reduced 
to the multiplication of two U(l)-invariant matrices. 

Let R and S be two U(l)-invariant matrices, with canonical 
forms 



R = ^R„, 5 = 05„. 



(94) 



Their product f = R ■ S, Eq. (4), is then another matrix f 
which is also block diagonal, 



et, 



(95) 



such that each block !„ is obtained by multiplying the 
corresponding blocks R„ and S„ , 



ifi — i\-/j ' O17 



(96) 



Equations (92) and (96) make evident the potential re- 
duction of computational costs that can be achieved by 
manipulating U(l)-invariant matrices in their canonical form. 
First, a reduction in memory space follows from only having 
to store the diagonal blocks in Eq. (92). Second, a reduction 
in computational time is implied by only having to multiply 
these blocks in Eq. (96). This is illustrated in the following 
example. 

Example 9. Consider a U(l)-invariant matrix T which is a 
linear map in a space V that decomposes into q iireps V„ , each 
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of which has the same degeneracy d„ = d. That is, T is a square 
matrix of dimensions dq x dq, with the block-diagonal form 
of Eq. (92). Since there are q blocks T„ and each block has size 
d X d, the U(l)-invariant matrix T contains qd^ coefficients. 
For comparison, a regular matrix of the same size contains 
q^d-^ coefficients, a number greater by a factor oi q. 

Let us now consider multiplying two such matrices. We 
use an algorithm that requires 0(1^) computational time to 
multiply two matrices of size I x I. The cost of performing q 
multiplications oi d x d blocks in Eq. (96) scales as 0(qd^). 
In contrast, the cost of multiplying two regular matrices 
of the same size scales as 0{q^d^), requiring q^ times 
more computation time. Figure 13 shows a comparison of 
computation times when multiplying two matrices for both 
U(l)-symmetric and regular matrices. 

H. Factorization of a matrix 

The factorization of a U(l) -invariant matrix T [Eq. (92)] 
can also benefit from the block-diagonal structure. Consider, 
for instance, the singular value decomposition T = USV of 
Eq. (1 1). In this case we can obtain the matrices 



U = ^U„, 5 = 05,,, ^ = 0^,, 



(97) 



by performing the singular value decomposition of each block 
T„ independently, 

t„ = U„S,X. (98) 

The computational savings are analogous to those described 
in example 9 above for the multiplication of matrices. Figure 1 3 
also shows a comparison of computation times required to 
perform a singular value decomposition on U(l)-invariant and 
regular matrices using MATLAB. 

I. Discussion 

In this section we have seen that U(l)-invariant tensors 
can be written in the canonical form of Eqs. (83) and (84), 
and that this canonical form is of interest because it offers a 
compact description in terms of only those coefficients which 
are not constrained by the symmetry. We have also seen that 
maintaining the canonical form during tensor manipulations 
adds some computational overhead when reshaping (fusing 
or splitting) indices, but reduces computation time when 
permuting indices (for sufficiently large tensors) and when 
multiplying or factorizing matrices (for sufficiently large 
matrix sizes). 

The cost of reshaping and permuting indices is proportional 
to the size IT"! of the tensors, whereas the cost of multiplying 
and factorizing matrices is a larger power of the matrix 
size, for example, \T\^^^. The use of the canonical form 
when manipulating large tensors therefore frequently results 
in an overall reduction in computation time, making it a very 
attractive option in the context of tensor network algorithms. 
This is exemplified in the next section, where we apply the 
MERA to study the ground state of quantum spin models with 
aU(l) symmetry. 

On the other hand, however, the cost of maintaining 
invariant tensors in the canonical form becomes more relevant 
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FIG. 13. (Color online) Computation times (in seconds) required 
to multiply two matrices (upper panel) and to perform a singular value 
decomposition (lower panel) as a function of the size of the indices. 
Matrices of size 5d x 5rf are considered. The figures compare the 
time required to perform these operations using regular matrices and 
U(I)-invariant matrices, where for the U(I)-invariant matrices each 
index contains five different values of the particle number n, each with 
degeneracy d, and the canonical form of Eqs. (92) and (93) is used. 
That is, each matrix decomposes into five blocks of size d x d. For 
large d, exploiting the block-diagonal form of U(l)-invariant matrices 
results in shorter computation time both for multiplication and for 
singular value decomposition. The asymptotic cost scales with d as 
0(d^), while the size of the matrices grows as 0(d^). We note that the 
fixed-cost overheads associated with symmetric manipulations could 
potentially vary substantially with choice of programming language, 
compiler, and machine architecture. The results given here show 
the performance of the authors' MATLAB implementation of U(l) 
symmetry. 



when dealing with smaller tensors. In the next section we 
will also see that in some situations, this additional cost 
may significantly reduce, or even offset, the benefits of 
using the canonical form. In this event, and in the specific 
context of algorithms where the same tensor manipulations 
are iterated many times, it is possible to significantly de- 
crease the additional cost by precomputing the parts of the 
tensor manipulations that are repeated on each iteration. 
Precomputation schemes are described in more detail in 
the Appendix. Their performance is illustrated in the next 
section. 
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V. TENSOR NETWORK ALGORITHMS WITH U(l) 
SYMMETRY: A PRACTICAL EXAMPLE 

In previous sections we have described a strategy to 
incorporate a U(l) symmetry into tensors, tensor networks, 
and their manipulations. To further illustrate how the strategy 
works in practice, in this section we demonstrate its use in 
the context of the multiscale entanglement renormalization 
Ansatz, or MERA, and present numerical results from our 
reference implementation of the U(l) symmetry in MATLAB. 



A. Multiscale entanglement renormalization Ansatz 

Figure 14 shows a MERA that represent states I*) e 
of a lattice C made of L = 18 sites (see Sec. HE). Recall that 
the MERA is made of layers of isometric tensors, known as 
disentanglers u and isometrics w, that implement a coarse- 
graining transformation. In this particular scheme, isometrics 
map three sites into one and the coarse-graining transformation 
reduces the L = 18 sites of £ into two sites using two layers of 
tensors. A collection of states on these two sites is then encoded 
in a top tensor t, whose upper index a = 1,2, . . . ,Xtop is used 
to label /top states l^n) e V®^. This particular arrangement 
of tensors corresponds to the 3:1 MERA described in Ref. 18. 

In this section we will consider a MERA analogous to that 
of Fig. 14 but with Q layers of disentanglers and isometrics, 
which we will use to describe states on a lattice C made of 
2 X 3^^ sites. We will use this variational Ansatz to obtain 
an approximation to the ground state and first excited states 
of two quantum spin chains that have a global internal U(l) 
symmetry, namely the spin-1/2 quantum XX chain of Eq. (67) 
and the spin-1/2 antiferromagnetic quantum Heisenberg chain 
of Eq. (68). Each spin-1/2 degree of freedom of the chain is 
described by a vector space spanned by two orthonormal states 
{ I l),\ t> }. Here we will represent them by the states { |0> , 1 1) } 
corresponding to zero and one particles, as in example 1 of 
Sec. Ill A. For computational convenience, we will consider a 
lattice C where each site contains two spins, or states, {| I],), 
I 4't)>l t^l-)'! tt)}- Therefore each site of £ is described by a 
space V = Vo ® Vi ® V2, where do = d2 = I and di = 2, as 
in example 2 of Sec. Ill A. Thus a lattice C made of L sites 
corresponds to a chain of 2L spins. In such a system, the total 
particle number A^ ranges from to 2L. (Equivalently, the 
z component of the total spin S- ranges from —L to L, with 
S, = N- L.) 



a=l,2,...,x,„ 




FIG. 14. (Color online) MERA for a system of L = 2 x 3" = 18 
sites, made of two layers of disentanglers u and isometries w, and a 
top tensor i. 



B. MERA with U(l) symmetry 

A U(l)-invariant version of the MERA, or U(l) MERA 
for short, is obtained by simply considering U(l)-invariant 
versions of all of the isometric tensors, namely the disen- 
tanglers M, isometries w, and the top tensor i. This requires 
assigning a particle number operator to each index of the 
MERA. Each open index of the first layer of disentanglers 
corresponds to one site of C. The particle number operator 
on any such index is therefore given by the quantum spin 
model under consideration. We can characterize the paiticle 
number operator by two vectors, n and d: a list of the different 
values the particle number takes and the degeneracy associated 
with each such particle number, respectively. In the case of the 
vector space V for each site of C described above, n = {0,1,2} 
and d = {1,2,1}. For the open index of the tensor i at the 
very top of the MERA, the assignment of charges is also 
straightforward. For instance, to find an approximation to the 
ground state and first seven excited states of the quantum 
spin model with particle number A'^, we choose n = {N} and 
d = {8}. (In particular, a vanishing S. corresponds to N = L.) 

For each of the remaining indices of the MERA, the 
assignment of the pair {n,d) needs careful consideration and a 
final choice may only be possible after numerically testing 
several options and selecting the one which produces the 
lowest expectation value of the energy. Table I shows the 
assignment of particle numbers and degeneracies made to 
represent the ground state and several excited states in a system 
of L = 2 X 3^ = 54 sites (that is, 108 spins) with total particle 
number N = L = 5A (or 5, = 0). Notice that at level q of 
the MERA {q = 1,2,3), each index effectively corresponds to 
a block of n^j = 3'' sites of C. Therefore having exactly n^ 
particles in a block of n^ sites corresponds to a density of one 
particle per site of £, . The assigned particle numbers of Table I, 
namely, [rty — 2,n^ — 1,«^,«^ + l,ng +2] for level q, then 
correspond to allowing for fluctuations of up to two particles 
with respect to the average density. The sum of correspond- 
ing degeneracies d = {d„^^.2,d„^,-i,d„^,,dn,,+\,d„^^+2} gives the 
bond dimension /, which in the example is x = 13. 

In order to find an approximation to the ground state of 
either Hxx or Hxxx in Eqs. (67) and (68), we set /top = 1 
and optimize the tensors in the MERA so as to minimize the 
expectation value 



(*|//|Vl/>, 



(99) 



where |*> e 
and H is the 



is the pure state represented by the MERA 
relevant Hamiltonian. In order to find an 



TABLE I. Example of particle number assignment in a U(l) 
MERA for L = 54 sites (or 108 spins). The total bond dimension 



isx = l-h3-h5-h3-hl 
in the text. 



13. The value of x,op is set as described 



Level q 



Particle numbers n 



Degeneracies d 



top 

3 
2 
1 




{N = 54) 

{25,26,27,28,29} 

{7,8,9,10,11} 

{1,2,3,4,5} 

{0,1,2} 



{/top} 

{1,3,5,3,1} 

{1,3,5,3,1} 

{1,3,5,3,1} 

{1,2,1} 
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< 




FIG. 15. (Color online) Error in ground-state energy Aii as a 
function of x for the XX and Heisenberg models with 2L = 108 
spins and periodic boundary conditions, in the particle number sector 
A' = L (or 5; = 0). The error is calculated with respect to the exact 
solutions, and is seen to decay exponentially with x ■ 



approximation to the Xtop > 1 eigenstates of H with lowest 
energies, we optimize the tensors in the MERA so as to 
minimize the expectation value 



Xtop 



^(*«l^l*«>, (*J*« 



(100) 



a=l 



The optimization is carried out using the MERA algorithm 
described in Ref. 18, which requires contracting tensor 
networks (by sequentially muhiplying pairs of tensors) and 
performing singular value decompositions. In the present 
example, all of these operations will be performed exploiting 
the U(l) symmetry. 

Figure 15 shows the error in the ground-state energy as 
a function of the bond dimension x> for assignments of 
degeneracies similar to those in Table II. The error is seen to 
decay exponentially with increasing x , indicating increasingly 
accurate approximations to the ground state. 



TABLE II. Number of coefficients required to specify the 
tensors of a MERA for L = 54 as a function of the bond di- 
mension x> decomposed according to a degeneracy vector d. A 
comparison is made between regular tensors and U(l)-invariant 
tensors. 







No. of 


No. of 






Degeneracy 


coefficients 


coefficients 




X 


d 


(regular) 


(symmetric) 


Ratio 


4 


[0,1,2,1,0] 


1552 


426 


3.6 




8 


[0,2,4,2,0] 


17216 


4714 


3.7 




13 


[1,3,5,3,1] 


115501 


21969 


5.3 




17 


[1,4,7,4,1] 


335717 


68469 


5.0 




21 


[1,5,9,5,1] 


779965 


166901 


4.7 




30 


[2,7,12,7,2] 


3243076 


639794 


5.1 





C. Exploiting the symmetry 

We now discuss some of the advantages of using the U(l) 
MERA. 

1. Selection of particle number sector 

An important advantage of the U(l) MERA is that it 
exactly preserves the U(l) symmetry. In other words, the states 
resulting from a numerical optimization are exact eigenvectors 
of the total particle number operator N [Eq. (57)]. In addition, 
the total particle number A^ can be preselected at the onset 
of optimization by specifying it in the open index of the top 
tensor i. 

Figure 16 shows the energy gap between the ground state 
and two excited states of an XX chain with 2L spins (or L 
sites), ior N = L particles (S, = 0). One is the first excited 
state which also has N = L particles. The other is the ground 
state in the sector with A' = L -|- 1 particles. The two energy 
gaps are seen to decay with the system size as L~' . The ability 
to preselect a given particle number A^ means that only two 
optimizations were required: one MERA optimization for A' = 
L with Xtop = 2 in order to obtain an approximation to the 
ground state and first excited state of Hxx in that particle 
number sector; and one MERA optimization for A'^ = L -|- 1 
with Xtop = 1 in order to obtain an approximation to the ground 
state of Hxx in the particle number sector A' = L -I- 1. 

Similar results can be obtained with the regular MERA. 
For instance, one can obtain an approximation to the ground 
state of a given paiticle number sector by adding a chemical 
potential term — /x X!s "*^^' to the Hamiltonian and carefully 
tuning the chemical potential term /x until the expectation 
value of the particle number N is the desired one. However, 
the regular MERA cannot guarantee that the states obtained 
in this way are exact eigenvectors of A^. Instead the resulting 
states are likely to have particle number fluctuations. 

Figure 17 shows the low-energy spectrum of the Heisenberg 
model Hxxx for a periodic system of L = 54 sites (or 



10' 



10" 



10" 



10" 



L+1 

exact value of A 
exact value of A, 



10' 



10' 
No. of spins 



10'^ 



FIG. 16. (Color online) Decay of energy gaps A with system size 
L in the XX model. The upper line corresponds to the energy gap 
Ai between the ground state and the first excited state in the N = L 
particle number (or S- = 0) sector. The lower line corresponds to 
the energy gap A^+i between the ground states of the N = L and 
N = L + I particle number sectors. 
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FIG. 17. (Color online) Low-energy spectrum of i?xxx with L = 
54 sites (= 108 spins). Depicted states have spins of zero (x, blue 
loops), one (+, red loops), or two (o, green loop), and total number 
of particles (A') between 52 and 56. Note that the second and third 
spin-1 triplets are twofold degenerate. 



108 spins), including the ground state and several excited 
states both in the particle sector A? = 54 (or S', = 0), and 
in neighboring particle sectors. Recall that Hxxx is actually 
invariant under a global internal SU(2) symmetry, of which 
particle number is a U(l) subgroup. Correspondingly the 
spectrum is organized according to irreps of SU(2), namely 
singlets (total spin 0), triplets (total spin 1), quintuplets (total 
spin 2), etc. Again, using the U(l) MERA, the five particle 
number sectors A^ = 52,53,54,55, and 56 can be addressed 
with independent computations. This implies, for instance, that 
in order to find the gap between the first and fourth singlets, we 
can simply set Af = 54 and /top = 9 on the open index of the 
top tensor i, to accommodate the first four spin-0 states and five 
spin- 1 states in the A^ = 54 sector, as seen in Fig. 17. In order to 
capture the fourth singlet using the regular MERA, we would 
need to consider at least Xtop = 19 (at a larger computational 
cost and possibly lower accuracy), since this state has only the 
19th lowest energy overall. 

2. Reduction of computational costs 

The use of U(l)-invariant tensors in the MERA also results 
in a reduction of computational costs. First, U(l) -invariant 
tensors, when written in the canonical form of Eqs. (83) and 
(84), are block diagonal and therefore require less storage 
space. Table II compares the number of MERA coefficients 
that need to be stored in the regular and symmetric case, for 
different choices of particle number assignments relevant to 
the present examples. 

Second, the computation time required to manipulate 
tensors is also reduced when using U(l)-invariant tensors 
in the canonical form. Figure 18 shows the computation 
time required for one iteration of the energy minimization 
algorithm of Ref . 1 8 (during which all tensors in the MERA 
are updated once), as a function of the total bond dimension 
X . The plot compares the time required using regular tensors 
and U(l)-invariant tensors. For U(l)-invariant tensors, we 
display the time per iteration for three different levels of 
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FIG. 18. (Color online) Computation time (in seconds) for one 
iteration of the MERA energy minimization algorithm, as a function 
of the bond dimension x- For sufficiently large x, exploiting the U(l) 
symmetry leads to reductions in computation time. The horizontal line 
on this graph shows that this reduction in computation time equates 
to the ability to evaluate MERAs with a higher bond dimension 
x: For the same cost per iteration incurred when optimizing a 
standard MERA in MATLAB with bond dimension x = 20, one may 
choose instead to optimize a U(l)-symmetric MERA with partial 
precomputation and X = 24, or with full precomputation and x = 28. 



precomputation, as described in the Appendix. The figure 
shows that for sufficiently large x , using U(l) -invariant tensors 
leads to a shorter time per iteration of the optimization 
algorithm. 

In the authors' reference implementation (written in MAT- 
LAB), using the symmetry without precomputation is seen to 
only reduce the computation time by about a factor of 2 for 
the largest x under consideration. This is because maintaining 
the canonical form for U(l)-invariant tensors still imposes a 
significant overhead for the values of x considered. In contrast, 
when using precomputation we obtained times shorter by a 
factor of 10 or more. 

The magnitude of the overhead imposed by maintaining the 
canonical form will depend on factors such as programming 
language and machine architecture, but in general more 
significant gains can be obtained by making full use of 
precomputation. This option, however, requires a significant 
amount of additional memory (see the Appendix), and a more 
convenient middle ground can be obtained by using a partial 
precomputation scheme. 

VI. CONCLUSIONS 

In this paper we have provided a detailed explanation of 
how a global internal Abelian symmetry may be incorporated 
into any tensor network algorithm. Following Ref. 52 we 
considered tensor networks constructed from tensors which 
were invariant under the action of the internal symmetry, and 
showed how each tensor may be decomposed according to a 
canonical form into degeneracy tensors (which contain all the 
degrees of freedom that are not affected by the symmetry) and 
structural tensors (which are completely determined by the 
symmetry). We then introduced a set of primitive operations 
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TABLE III. Fusion rules for the group 
^3: Outcomes of evaluating a x a'. 









a 









I 


2 










1 


2 


a' 


1 


1 


2 







2 


2 





1 



The formalism presented in this paper is therefore directly 
applicable to any Abelian group. 
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V which may be used to carry out tensor network algorithms 
using Ansatze such as MPS, PEPS, and MERA, and showed 
how each of these operations can be implemented in such a 
way that the canonical form is both preserved and exploited 
for computational gain. 

We then demonstrated the implementation of this decom- 
position for tensors with an internal U(l) symmetry, and 
computed multiple benchmarks demonstrating the compu- 
tational costs and speedups inherent in this approach. We 
found that although maintaining the canonical form imposed 
additional costs when combining or splitting tensor indices, 
for simulations of a sufficiently large scale these costs can 
be offset by the gains made when performing permutations, 
matrix multiplications, and matrix decompositions. 

Finally, we implemented the MERA on a quantum spin 
chain with U(l) symmetry. We showed that exploitation of 
this symmetry can lead to a decrease in the computational 
cost by a factor of between 10 and 20. These gains may 
be used either to reduce overall computation time or to 
permit substantial increases in the MERA bond dimen- 
sion /, and consequently in the accuracy of the results 
obtained. 

Although in this paper we have focused on an example 
which is a continuous Abelian group, the formalism presented 
here may equally well be applied to a finite Abelian group. 
In particular let us consider a cyclic group Z^, q e Z"'".^'' 
As in the case of U(l), the Hilbert space decomposes under 
the action of the group into a direct sum of one-dimensional 
irreps which are each characterized by an integer charge 
a, and consequently most of the analysis presented in this 
paper remains unchanged. In particular, matrices which are 
invariant under the action of the group will be block diagonal 
in the basis labeled by charge according to Eq. (35), and 
symmetric tensors enjoy the canonical decomposition stated in 
Eqs. (83) and (84). The only objects which need modification 
are the fusion and splitting maps, which need to be altered 
so that they encode the fusion rules for Z^ instead for U(l). 
For a cyclic group Zq, the fusion of two charges a and a' 
gives rise to a charge a" according to a" = {a -\- a')\q where 
\q indicates that the addition is peiformed modulo q. For 
example, Z3 has charges a = 0, 1,2, and the fusion rules for 
Z3 take the form a x a' ^ a" where the value of a" is given in 
Table III. 

More generally, a generic Abelian group will be character- 
ized by a set of charges {a\ ,02,03, . . .). When fusing two such 
sets of charges (ai ,02,01,, . . .) and io\ ,0'2,0'j^, . . .), each charge 
Oi is combined with its counterpart o[ according to the fusion 
rule of the relevant subgroup. Once again, this behavior may 
be encoded in a single fusion map T^"'*'^ and its inverse T'^p'". 



APPENDIX: USE OF PRECOMPUTATION IN ITERATIVE 
ALGORITHMS 

We have seen that the use of the canonical form given 
in Eqs. (83) and (84) to represent U(l)-invariant tensors 
can potentially lead to substantial reductions in memory 
requirements and in calculation time. We also pointed out, 
however, that there is an additional cost in maintaining an 
invariant tensor in its canonical form, and that this is associated 
with the reshaping (fusing and/or splitting) of its indices. In 
some situations this additional cost may significantly reduce, 
or even offset, the benefits of using the canonical form. 

In this Appendix we investigate techniques for reducing 
this additional cost in the context of iterative tensor network 
algorithms. Many of the algorithms discussed in Sec. HE are 
iterative algorithms, repeating the same sequence of tensor 
network manipulations many times over. Examples include 
algorithms which compute tensor network approximations to 
the ground state by minimizing the expectation value of the 
energy or by simulating evolution in imaginary time, with each 
iteration yielding an increasingly accurate approximation to 
the ground state of the system. 

The goal of this Appendix is to identify calculations which 
depend only on the symmetry group, and are independent of 
the variational coefficients of such algorithms. Where these 
calculations are repeated in each iteration of the algorithm, we 
can effectively eliminate the associated computational cost by 
performing them only once, either during or prior to the first 
iteration of the algorithm, and then storing and reusing these 
precomputed results in subsequent iterations. We will illustrate 
this procedure by considering the precomputation of a series 
of operations applied to a single tensor T. 

To do this, we begin by revisiting the fusion and splitting ta- 
bles of Sec. Ill C and introducing a graphical representation of 
these objects. We then introduce a convenient decomposition 
of a symmetric tensor into a matrix accompanied by multiple 
fusion and/or splitting tensors, and linear maps F that map 
one such decomposition into another. These linear maps are 
independent of the coefficients of the tensor being reorganized, 
and consequently they are precisely the objects which can 
be precomputed in order to quicken an iterative algorithm at 
the expense of additional memory cost. Finally we describe 
two specific precomputation schemes, differing in what is 
precomputed and in how the precomputed data are utilized 
during the execution of the algorithm, in order to illustrate 
the tradeoff between the amount of memory needed to store 
the precomputation data and the associated computational 
speedup which may be obtained. In practice, the nature of the 
specific implementation employed will depend on available 
computational resources. 
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1. Diagrammatic notation of fusing and splitting tensors 

In describing how we can precompute repeated manipula- 
tions of this tensor T, we will find it useful to employ diagram- 
matic representations of the fusion and splitting tables T^"^'' 
and T'^P'" introduced in Sec. IIIC. These tables implement a 
linear map between a pair of indices and their fusion product, 
and thus can be understood as trivalent tensors having two 
input legs and one output leg (or vice versa) in accordance 
with Sec. II F. We choose to represent them graphically as 
shown in Fig. 19(a), where the arrow within the circle always 
points toward the coupled index. The linear maps T^"^*^ and 
Y split 2j.g jjjjji^aj-y^ and consequently we impose that the tensors 
of Fig. 19(a) must satisfy the identities given in Fig. 19(b), 
corresponding to unitarity under the action of the conjugation 
operation employed in diagrammatic tensor network notation 
(vertical reflection of a tensor and the complex conjugation 
of its components, typically denoted t). Our notation also 
reflects the property, first noted in Sec. IIIC, that T^"^*^ and 
yspiit j^ay be decomposed into two pieces [Fig. 19(c)]. For 
the fusion tensor, we identify the first piece (represented by a 
circle containing an arrow) with the creation of a composed 
index using the manner we would employ in the absence of 
symmetry (2). The second piece, represented by the small 
square, permutes the basis elements of the composed index, 
reorganizing them according to total particle number. The 
two components of the splitting tensor are then uniquely 
defined by consistency with the process of conjugation for the 
diagrammatic representation of tensors, and with the unitarity 
condition of Fig. 19(b). 



(a) 







n,„t. 



AB'nj, 



«/.. nj. 



(b) 




f^AB^n... ni_ nJ, 



A'-t,,, "«'«. n.t„ nj„ 



A 



(C) "a'^j ITgt^ n/^^ Hgt^ 



n„t. 



\nj„ ^nj. 



a'„, ^"b\. 



n„t. 



n„t. 



nJ. 




'"' "bK. nj„^ n^t^ 



FIG. 19. (a) Graphical representation of the fusion tensor T''"^"^ 
and the splitting tensor T'p"'. (b) The tensors T''"'^ and T^'p"' are 
unitary, and thus yield the identity when contracted pairwise as shown. 
(c) A fusion tensor decomposed into two parts. The first part (indicated 
by a circle with an arrow) performs the tensor product of input irreps, 
haIa X ngtB- The result is an index that labels pairs (nAtA,i^BtB)- The 
second part (indicated by a rectangle) is a permutation that associates 
each pair (riAtA^nBtB) with a unique (nABtujis), corresponding to a 
vector in the coupled basis of V*"^'. 



T 





'2 h L 



FIG. 20. (Coloronline)Binary tree decomposition of asymmetric 
tensor T having components 7i,(2'3'4'5'V,- The tree T is comprised of 
a matrix M as the root node, four splitting tensors as internal nodes, 
and / 1 , !2 , ■ ■ ■ , '6 as its leaf indices. No incoming or outgoing arrows are 
indicated on the indices in the figure, as the decomposition is valid 
for any such assignment of directional arrows. 

These requirements have an important consequence. Sup- 
pose the first part of T^"^*^ implements i> x c — >■ rf by iterating 
rapidly over the values of b and more slowly over the values of 
c, and b lies clockwise of c on the graphical representation of 
-j-fuse -pjjjg j-j^gjj means that on the graphical representation 
of T'^P'" which implements d ^ b x c, index b must lie 
counterclockwise of c. It is therefore vitally important to 
distinguish between the splitting tensor and a rotated depiction 
of the fusing tensor. To this end we require that when using 
this diagrammatic notation, all tensors (with the exception 
of the fusion and splitting tensors) must be drawn with only 
downward-going legs, as seen, for example, in Fig. 20, though 
the legs are still free to carry either incoming or outgoing 
arrows as before. 

2. Tree decomposition 

We find it convenient to decompose a rank-A:, U(l)-invariant 
tensor T, having components Tj^i^...i^, as a binary tree tensor 
network T consisting of a matrix M which we will call the root 
node, and oik — 2 splitting tensors T^p'" as branching internal 
nodes, with the leaf indices of tree T corresponding to the 
indices {i\,i2, ■ ■ ■ ,ik} of tensor T. We refer to decomposition 
T as a tree decomposition of T. Figure 20 shows an example 
of tree decomposition for a rank-6 tensor. It is of the form 



T 



r^ split 



M,-,,T 



'-111 



split 



■ T 

.J3 ;; 



split 



xT 



j-i- 



T 

n.n u 



split 



(Al) 



where {}\^h^h^h\ ^s the internal indices of the tree. 

The same tensor f may be decomposed as a tree in 
many different ways, corresponding to different choices of 
the fusion tree. As an example we show two different but 
equivalent decompositions of a rank-4 tensor in Fig. 21. 
Different choices 7T,72, ■ ■ ■ of tree decomposition for tensor 
f will lead to different matrix representations M\,M2, ■ ■ ■ of 
the same tensor. Finally, Fig. 22 shows how to obtain the tree 
decompositions from Ti^i,j^i^ by introducing an appropriate 
resolution of the identity, constructed from pairs of fusion 
operators T^"^*^ and splitting operators T^p'" in accordance 
with Fig. 19(b). 
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M = 




h '2 h '4 




FIG. 21. (Color online) Two possible tree decompositions of a 
rank-4 tensor T. Different choices TitTl, ■ ■ ■ of tree decomposition 
for tensor T lead to different matrices Mi , M2 , ... for the same tensor. 



The representation of a tensor f by means of a tree 
decomposition is particularly useful because many tensor 
network algorithms may be understood as a sequence of 
operations carried out on tensors reduced to matrix form. 
For example, consider tensor network algorithms such as 
MPS, MERA, and PEPS. When tensors are updated in these 
algorithms, the new tensor is typically created as a matrix, to 
which operations from the primitive set V of Sec. II D are then 
applied. When they are decomposed or contracted with other 
tensors, this may once again take place with the tensor in matrix 
form. Any such matrix form may always be understood as the 
matrix component of an appropriate tree decomposition T of 
tensor t, where the sequence of operations reshaping tensor 
T to matrix M corresponds to the contents of the shaded area 
in Fig. 22. 



M.= 



h h h '4 





'1 '? ^1 ^4 





2 '3 14 

FIG. 22. (Color online) Tree decompositions of tensor T are 
obtained by contracting the tensor with an appropriate resolution 
of the identity on its indices, selected according to the desired choice 
of the fusion tree T. In each instance, evaluation of the contents of 
the shaded region yields the appropriate matrix M. 








FIG. 23. (Color online) A matrix M\ can be reorganized into 
another matrix M2 by means of fusion tensors, splitting tensors, and 
the permutation of indices. These operations define a one-to-one 
linear map T that acts to reorganize the coefficients of Mi . T does 
not depend on the coefficients of Mi , but solely on the sequence of 
operations performed. 

3. Mapping between tree decompositions 

Suppose now that we have a tensor T in matrix form 
Ml, which is associated with a particular choice of tree 
decomposition 77, and we wish to transform it into another 
matrix form M2, corresponding to another tree decomposition 
Ti- As indicated, this process may frequently arise during the 
application of many common tensor network algorithms. The 
new matrix Mj can be obtained from Mi by means of a series 
of reshaping (splitting/fusing) and permuting operations, as 
indicated in Fig. 23, and this series of operations may be 
understood as defining a map F : 



M2 = r(Mi). 



(A2) 



The map F is a linear map which depends only on the 
tree structure of 71 and T2, and is independent of the 
coefficients of Mi. Moreover, F is unitary, and it follows 
from the construction of fusing and splitting tensors and 
the behavior of permutation of indices (which serves to 
relocate the coefficients of a tensor) that F simply reorganizes 
the coefficients of Mi into the coefficients of M2 in a one-to- 
one fashion. 

Therefore one way to compute the matrix M2 from 
matrix Mi is by first computing the linear map F, which is 
independent of the specific coefficients in tensor T , and by 
then applying it to Mi . 

4. Precomputation schemes for iterative tensor 
network algorithms 

The observation that the map F is independent of the 
specific coefficients in Mi is particularly useful in the context 
of iterative tensor network algorithms. It implies that, although 
the coefficients in Mi will change from iteration to iteration, 
the linear map F in Eq. (A2) remains unchanged. It is therefore 
possible to calculate the map F once, during the first iteration 
of the simulation, and then to store it in memory and reuse 
it during subsequent iterations. We refer to such a strategy 
as a precomputation scheme. Figure 24 contrasts the program 
flow of a generic iterative tensor network algorithm with and 
without precomputation of the transformations F . 
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FIG. 24. (Color online) Flow diagram for the execution of a 
predetermined number of iterations of a generic iterative tensor 
network algorithm, (a) without any precomputation and (b) with 
precomputation of the operations P. 

Using such a precomputation scheme, a significant speedup 
of simulations can be obtained, at the price of storing 
potentially large amounts of precomputed data (as a single 
iteration of the algorithm may require the application of many 
different transformations F). Therefore a tradeoff necessarily 
exists between the amount of speedup that can be obtained and 
the memory requirement that this entails. In this section we 
describe two different precomputation schemes. The first one 
fully precomputes and stores all maps F, and is relatively 
straightforward to implement. This results in the maximal 
increase in simulation speed, but implementation requires a 
large amount of memory. The second scheme only partially 
precomputes the maps F, resulting in a moderate speedup of 
simulations, but with memory requirements which are also 
similarly more modest. 

a. Maximal precomputation scheme 

As noted in Sec. Ill of this Appendix, applying the map F 
to a matrix M\ simply reorganizes its coefficients to produce 
the matrix M2. Moreover, if the indices of matrices M\ and 
M2 are fused to yield vectors Vi and V2 then the map F may 
be understood as a permutation matrix, and this in turn may be 
concisely represented as a string of integers T = y\, . . . ,Y\ma 
such that entry / of y2 = T V\ is given by entry y, of vector 
Vi . Because all of the elements from which F is composed 
are sparse, unitary, and composed entirely of O's and I's, 
the permutation to which F corresponds may be calculated 
at a total cost of only 0{\M\\), where \Mi\ counts only 
the elements of M\ which are not fixed to be zero by the 
symmetry constraints of Eq. (83). In essence, for each element 
of the vector Vi one identifies the corresponding number and 

degeneracy indices (M; ',?; ') on each leg / e {1,2} of matrix 
Ml . One can then read down the figure, applying each table 
yfuse gj. yspiit jjj j-yj.jj ^Q identify the corresponding labels (n', ?') 
on the intermediate legs, until finally the corresponding labels 
on the indices of M2 are obtained. There is then a further 1 : 1 
mapping from each set of labels (nf\tf-), («^-,r^-) on M2 



to the corresponding entry in V2, completing the definition of 
F as a map from V[ to V2- 

Storing the map F for a transformation such as the one 
shown in Fig. 23 imposes a memory cost of 0{\Mi\). The 
application of this map also incurs a computational cost of 
0(1 Ml I), but computational overhead is saved in not having to 
reconstruct the map F on every iteration of the algorithm. 



b. Partial precomputation scheme 

The 0{\Mi I) memory cost incurred in the previous scheme 
can be significant for large matrices. However, we may reduce 
this cost by replacing the single permutation F employed in 
that scheme with multiple smaller operations which may also 
be precomputed. In this approach Mj is retained in matrix form 
rather than being reshaped into a vector, and we precompute 
permutations to be performed on its rows and columns. 

First, we decompose all the fusion and splitting tensors into 
two pieces in accordance with Fig. 19(c). Next, we recognize 
that any permutations applied to one or more legs of a fusion or 
splitting tensor may always be written as a single permutation 
applied to the coupled index [Fig. 25(a)]. We use this to replace 
all permutations on the intermediate indices of the diagram 
with equivalent permutations acting only on the indices of 
Ml and the open indices, as shown for a simple example 
in Fig. 25(b). The residual fusion and splitting operations, 
depicted by just a circle enclosing an arrow, then simply carry 
out fusion and splitting of indices as would be performed in the 
absence of symmetry (2), (3). These operations are typically 
far faster than their symmetric counterparts as they do not need 
to sort the entries of their output indices according to particle 
number. 



(a) 





(b) 





M2 



FIG. 25. (Color online) (a) Permutations applied to one or more 
legs of a fusion or splitting tensor can be replaced by an appropriate 
permutation on the coupled index. This process can be used to 
replace all permutations applied on internal indices of a diagram 
such as Fig. 23 with net permutations on the indices of Mi and on 
the open indices of the network, as in shown in (b). The residual 
fusion and splitting operations, depicted as an arrow in a circle, 
simply perform the basic tensor product operation and its inverse, 
Eqs. (2) and (3), as described in Fig. 19(c) and Sec. I of this 
Appendix. 
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In subsequent iterations, the matrix M2 is obtained from 
Ml by consecutively 

(1) permuting the rows and columns of Mi using the 
precomputed net permutations which act on the legs of Mi ; 

(2) performing any elementary (nonsymmetric) splitting, 
permuting of indices, and fusing operations, as described by 
the gray-shaded region in Fig. 25(b); 

(3) permuting the rows and columns of the resulting matrix, 
using the precomputed net permutations which act on the open 
legs of Fig. 25(b). 

When matrix Mi is defined compactly, as in Eq. (83), 
so that elements which are identically zero by symmetry 
are not explicitly stored, a tensor T is constructed from 
multiple blocks identified by U(l) charge labels on their 
indices [T],,,,, „,. in Eq. (83)]. Under these conditions the 
elementary splitting, fusing, and permutation operations of 



step (2) above are applied to each individual block, but some 
additional computational overhead is incurred in determining 
the necessary rearrangements of these blocks arising out of the 
actions performed. This rearrangement may be computed on 
the fly, or may also be precomputed as a mapping between the 
arrangement of blocks in M\ and that in M2- 

The memory required to store the precomputation data in 
this scheme is dominated by the size of the net permutations 
collected on the matrix indices, and is therefore of 0(v l^i I)- 
The overall cost of obtaining Mj from Mi is once again of 
0(1 Ml I), but is in general higher than the previous scheme as 
this cost now involves two complete permutations of the matrix 
coefficients, as well as a reorganization of the block structure of 
Ml which may possibly be computed at runtime. Nevertheless, 
in situations where memory constraints are significant, partial 
precomputation schemes of this sort may be preferred. 
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I 



In this and the following chapter we will address the implementation of global non-Abelian 
symmetries into tensor network algorithms. We consider the specific context of an internal 
SU(2) symmetry, that gives rise to spin isotropy. This is an extremely important symmetry 
that appears amply in lattice spin models. 

In this chapter we will focus on the conceptual aspects of incorporating the symmetry. 
The theoretic formalism developed in Chapter 3 will be adapted to the specific case of 
SU(2) symmetry. We consider tensors that are invariant under the action of SU(2). The 
structural tensors, that are part of the canonical decomposition, are highly non-trivial 
(and are given in terms of the Clebsch-Gordan coefficients). However, the key advantage 
of the canonical decomposition is that it allows tensor manipulations, such as reshape 
or permutation of indices, to be broken into an independent manipulation of degeneracy 
tensors and of structural tensors. 

In the context of numerical simulations the canonical decomposition leads to a computa- 
tional gain. Computational cost is incurred only when manipulating degeneracy tensors. 
One the other hand, structural tensors are manipulated algebraically by exploiting prop- 
erties of the Clebsch-Gordan coefficients. Manipulations of the structural tensors reduce 
to evaluating a spin network. This process involves integrating over the degrees of free- 
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dom associated with spin projection, which are therefore suppressed in the outcome of 
the tensor manipulation, as is expected in a spin isotropic description. 

In Chapter 6 we will describe a specific implementation scheme of elementary manipula- 
tions of SU(2)-invariant tensors. We will address several concerns that are of importance 
in the practical implementations of the symmetry. 



5.1 Preparatory Review: Tensor network formalism 

In this section we review the basic formalism of tensors and tensor networks. Even though 
we do not make any explicit reference to symmetry here, our formalism is directed towards 
SU(2)-invariant tensors. 

We begin by recalling the basic notion of a tensor. A tensor T is a multidimensional array 
of complex numbers Ti^^i^..^^- The rank of a tensor is the number k of indices. The size of 
an index i, denoted \i\, is the number of values that the index takes, i G 1, 2, . . . , |i|. The 
size of a tensor T, denoted |T|, is the number of complex numbers it contains, namely, 

\T\ = \ii\ X 1^21 X ... X \ik\. 

5.1.1 Tensors as linear maps 

For the purpose of this thesis we regard a rank-A; tensor as a linear map. To this end, we 
first equip each index i;, I = 1,2, . . . ,k, of the tensor with a direction: 'in' or 'out', that 
is, either incoming into the tensor or outgoing from the tensor respectively. We denote 
by D the directions associated with the indices of tensor T, namely, D{1) = 'in' if ii is an 
incoming index and D{1) = 'out' if ii is outgoing. 

Let us also use index i of the tensor to label a basis \i) of a complex vector space V^ = C'*' 
of dimension \i\. Then a rank-one {k = 1) tensor with an outgoing index i represents a 
vector in V^*', a rank-two (k = 2) tensor T with one incoming index a and one outgoing 
index b represents a matrix and so on. 
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(i) 

o 




Figure 5.1 - Graphical representation of tensors by means of a shape e.g. circle or a 
"blob" with emanating lines corresponding to indices of the tensor. Indices may be incom- 
ing or outgoing as indicated by arrows, (i) Graphical representations of tensors with rank 
0,1 and 2, corresponding to a complex number c G C, a vector \v) G C^ and a matrix 
M G cl'^l^l^'L (ii) Graphical representation of a tensor T with components Tabcd with direc- 
tions D = {'in', 'out', 'in', 'out'}. Notice that the indices emerge in a counterclockwise order, 
perpendicular to the boundary of the blob; the first index is identified by the presence of by a 
dot within the blob close to the index. All arrows in a tensor diagram point downwards, that 
may be interpreted as choosing a metaphorical "time" that flows downwards. 

A tensor can be unambiguously regarded as a linear map from a vector space to complex 
numbers C For instance, a vector can be regarded as a linear map from V^*' to C, a 
matrix T can be regarded as a linear map from (V'"^')* V^'*' to C where (V^'^l)* is the dual 
of vector space Vf"' etc. More generally, we can use a rank-fc tensor T to define a linear 
map from the tensor product of k vector spaces to C in the following way. Define a set 
W^*'], I = 1,2, . . . ,k, oi k spaces where 

V[^'] if 3(1) = 'out', , , 

^ 5.1 

(V^])* if D(/) = 'in', 

where the (V'*'')* is the dual of vector space V'*'^ Then tensor T can be regarded as a 
linear map from the product space (^^ W^''^ to C, 

f : (g)W[^'l ^C. (5.2) 

I 

We will find this viewpoint of tensors useful for subsequent generalization to SU(2)- 

invariant tensors. 

It is convenient to use a graphical representation of tensors, as illustrated in Fig. 1, where 
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a tensor is depicted as a "blob" (or by a shape e.g., circle, square etc.) and each of its 
indices is represented by a line emerging perpendicular from the boundary of the blob. In 
order to specify which index corresponds to which emerging line, we follow the prescription 
that the lines corresponding to indices {ii,i2, ■ ■ ■ ,ik} emerge in counterclockwise order. 
The first index corresponds to the line emerging closest to a mark (black dot) inside the 
boundary of the blob (or the first line encountered while proceeding counterclockwise from 
nine o'clock in case the tensor is depicted as a circle without a mark). The direction of 
an index is depicted by attaching an arrow to the line corresponding to the index. We 
follow a convention that all arrows in a diagram point downwards. 

5.1.2 Elementary manipulations of a tensor 

A tensor can be transformed into another tensor in several elementary ways. These 
include, reversing the direction of one or several of its indices, permuting its indices, 
and/or reshaping its indices. 

Reversing the direction of an index corresponds to mapping the vector space that is 
associated with the index to its dual. For example, in 

(f'U = Tab, (5.3) 

if index a is associated to a vector space V'^^ , then index a that is obtained by reversing 
the direction of a is associated with the dual space (Vf"')*. Since all arrows in a diagram 
point downwards, reversing the direction of an index i is depicted [Fig. 5.2(i)] by 'bending' 
the line corresponding to i upwards if it is an outgoing index or downwards if it is an 
incoming index. Since tensor T' is components wise equal to tensor T arrows appear to 
be irrelevant in the absence of the symmetry. However, arrows will play an important 
role when we consider SU(2)-invariant tensors since they specify how the group acts on 
each index of a given tensor. 

A permutation of indices corresponds to creating a new tensor T' from T by simply 
changing the order in which the indices appear, e.g. 

if')bac = fabc. (5.4) 
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(i) 



T 



\' 




T 








d — axb 



b ^ b 



Figure 5.2 - Transformations of a tensor: (i) Reversing direction of an index, Eq. (5.3). {ii) 
Permutation of indices, Eq. (5.4). (ii) Fusion of indices a and b into d = a x b, Eq. (5.5); 
splitting of index d = a x b into a and b, Eq. (5.6). 



Permutation of indices is depicted by intercrossing indices, as illustrated in Fig. 5.2(ii). 
Note that when the permutation involves the first index of the tensor the mark, that 
indicates the first index, is also shifted to a new location within the blob. It is useful to 
note that an arbitrary permutation of the indices can be broken into a sequence of swaps 
of adjacent indices wherein the position of two indices are interchanged at a time. 

Last but not the least, a tensor T can be reshaped into a new tensor T' by 'fusing' two 
adjacent indices into a single index and/or 'splitting' an index into two indices. For 
instance, in 



if'] 



dc 



T, 



abci 



d = a X b. 



(5.5) 



tensor T' is obtained from tensor T by fusing indices aG{l,---,|a|} and be {I,--- ,\b\} 
together into a single index d of size \d\ = \a\ ■ \b\ that runs over all pairs of values of a 
and b, i.e. d G {(1, 1), (1, 2), ■ ■ ■ , (|a|, |6| — 1), (|a|, \b\)}, whereas in 



T, 



abc 



if') 



do 



d = a X b, 



(5.6) 



tensor T is recovered from T' by splitting index d of T' back into indices a and b. Reshape 
of the indices is depicted as shown in Fig. 5.2(iii). 
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= ^'b 



R 




Figure 5.3 - (i) Graphical representation of the matrix multiplication of two matrices R 
and S into a new matrix T, Eq. (5.7). (ii) Graphical representation of an example of the 
multiplication of two tensors R and S into a new tensor T, Eq. (5.8). 

5.1.3 Multiplication of two tensors 



Given two matrices R and S with components Rab and She-, we can multiply them together 
to obtain a new matrix T, T = R ■ S, with components 



T 



/ ^ J^ab^bc 



(5.7) 



by summing over or contracting index h. The multiplication of matrices R and S is rep- 
resented graphically by connecting together the emerging lines of R and S corresponding 
to the contracted index, as shown in Fig. 5.3(i). 

Matrix multiplication can be generalized to tensors, such that, an incoming index of 
one tensor is identified and contracted with an outgoing index of another. For instance, 
given tensor R with components Rabcde and directions {'in', 'out', 'in', 'out', 'out'}, and 
tensor S with components Scdfbg and directions {'out', 'in', 'in', 'in', 'out'}, we can define 
a tensor T with components Tgaje that are given by. 



T, 



afge 



E« 



abcde'J cdfbg 



(5. 



bed 



Note that each of the indices 6, c and d, that are contracted, is incoming into one tensor 
and outgoing from the other. The multiplication is represented graphically by connecting 
together the lines emerging from R and S corresponding to each of these indices, as shown 
in Fig. 5.3(ii). 
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e a e 




bed 



(2) R* = R 



(3) T"A. - 



W 




Figure 5.4 - Graphical representations of the five elementary steps 1-5 into which one can 
decompose the multiplication of the tensors of Eq. (5.8). 

Multiplication of two tensors can be broken down into a sequence of elementary steps 
by transforming the tensors into matrices, multiplying the matrices together, and then 
transforming the resulting matrix back into a tensor. Next we describe these steps for the 
contraction given in Eq. (5.8). They are illustrated in Fig. 5.4. 



1. Reverse and Permute the indices of tensor R in such a way that the indices 6, c and 
d that are contracted appear in the last positions as outgoing indices and in a given 
order, e.g. hcd, and the remaining indices a and e appear in the first positions as 
incoming indices; similarly reverse and permute the indices of S so that the indices 



64 Implementation of non-Abelian symmetries I 

b, c and d appear in the first positions as incoming indices and in the same order, 
bed, and the remaining indices / and g appear in the last positions as outgoing 
indices, 



3) 



I, -'I- )ae bed \-'^)abcdej 

iS')bcd Jg = iS)cdfbg- (5.9) 

2. Reshape tensor R' into a matrix R" by fusing into a single index u all the indices 
that are not contracted, u = a x e, and into a single index y all indices that are 
contracted, y = b x c x d; similarly reshape tensor 5" into a matrix S" with indices 
y = b X c X d and w = f x g (indices b, c and d are required to be fused according 
to the same fusion sequence in the two tensors. A possible fusion sequence may 
involve, for example, first fusing b and c and then fusing the resulting index with 
d), 

\J^ juy \J^ Jaebcd) 

[o )yw = [^ Jbcdjg- (5.10) 

3. Multiply matrices R" and S" to obtain a matrix T' with components 

if"U = Y,iR")uy iS")yy^- (5.11) 

y 

4. Reshape matrix T' into a tensor T by splitting indices u = a x e and w = f x g, 

{f'Ufg = if"U. (5.12) 

5. Reverse and Permute indices of tensor T' in the order in which they appear in T, 

Tafge = {f')^^j^. (5.13) 

The contraction of Eq. (5.8) can be implemented at once, without breaking the multi- 
plication down into elementary steps. However, it is often more convenient to compose 
the above elementary steps since, for instance, in this way one can use existing linear 
algebra libraries for matrix multiplication. In addition, it can be seen that the leading 
computational cost in multiplying two large tensors is not changed when decomposing the 
contraction in the above steps. 
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(i) 



\^ 



fn 



V 



= s 



u 



(ii) 




a d 

V 

sO 



Figure 5.5 - (i) Factorization of a matrix T according to a singular value decomposition, 
Eq. (5.14). (ii) Factorization of a rank-4 tensor T according to one of several possible singular 
value decompositions. 

5.1.4 Factorization of a tensor 



A matrix T can be factorized into the product of two (or more) matrices in one of several 
canonical forms. For instance, the singular value decomposition 



Tab — 2_^ UacScdVdb — 2_^ UacScVcb 



(5.14) 



c,d 



factorizes T into the product of two unitary matrices U and V, and a diagonal ma- 
trix S with non-negative diagonal elements Sc = Sec known as the singular values of T 
[Fig. 5.5(i)]. On the other hand, the eigenvalue or spectral decomposition of a square 
matrix T is of the form 



fab = J2MacDUM-')db = Y,MacXc{M-^\ 



cb 



(5.15) 



c,d 



where M is an invertible matrix whose columns encode the eigenvectors |Ac) of T, 



T\ac} — Ac|Ac), 



(5.16) 



M~^ is the inverse of M, and D is a diagonal matrix, with the eigenvalues Ac = Dec on 
its diagonal. Other useful factorizations include the LU decomposition, the QR decom- 
position, etc. We refer to any such decomposition generically as a matrix factorization. 
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Figure 5.6 - (i) Example of a tensor network J\f . (ii) Tensor T of which the tensor network 
M could be a representation, (iii) Tensor T can be obtained from J\f through a sequence of 
contractions of pairs of tensors. Shading indicates the two tensors to be multiplied together 
at each step. The product tensor is depicted by a blob that covers the two tensors that are 
multiplied. 

A tensor T with more than two indices can be converted into a matrix in several ways 
by specifying how to join its indices into two subsets. After specifying how tensor T is 
to be regarded as a matrix, we can factorize T according to any of the above matrix fac- 
torizations, as illustrated in Fig. 5.5(ii) for a singular value decomposition. This requires 
first reversing directions, permuting and reshaping the indices of T to form a matrix, then 
decomposing the latter, and finally restoring the open indices of the resulting matrices 
into their original form by undoing the reshapes, permutations and reversal of directions. 



5.1.5 Tensor networks and their manipulation 



A tensor network A/" is a set of tensors whose indices are connected according to a network 
pattern, e.g. Fig. 5.6. 

Given a tensor network A/", a single tensor T can be obtained by contracting all the indices 
that connect the tensors in A^ [Fig. 5.6(ii)]. Here, the indices of tensor T correspond to 
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the open indices of the tensor network M . We then say that the tensor network A/" is a 
tensor network decomposition of T. One way to obtain T from M is through a sequence 
of contractions involving two tensors at a time [Fig. 5.6(iii)]. Notice how a tensor that is 
obtained by contracting a region of a tensor network is conveniently depicted by a blob 
or shape that covers that region. 

From a tensor network decomposition M for a tensor T, another tensor network decompo- 
sition for the same tensor T can be obtained in many ways. One possibility is to replace 
two tensors in M with the tensor resulting from contracting them together, as is done 
in each step of Fig. 5.6(iii). Another way is to replace a tensor in M with a decomposi- 
tion of that tensor (e.g. with a singular value decomposition). In this thesis, we will be 
concerned with manipulations of a tensor network that, as in the case of multiplying two 
tensors or decomposing a tensor, can be broken down into a sequence of operations from 
the following list: 

1. Reversal of direction of indices of a tensor, Eq. (5.3). 

2. Permutation of the indices of a tensor, Eq. (5.4). 

3. Reshape of the indices of a tensor, Eqs. (5.5)-(5.6). 

4. Multiplication of two matrices, Eq. (5.7). 

5. Factorization of a matrix (e.g. singular value decomposition Eq. (5.14) or spectral 
decomposition Eq. (5.15). 

These operations constitute a set V of primitive operations for tensor network manipula- 
tions (or, at least, for the type of manipulations we will be concerned with). In Sec. 5.6 
(and again in Chapter 6) we discuss how this set V of primitive operations can be gener- 
alized to tensors that are invariant under the action of the group SU(2). 

Next we review basic background material concerning the representation theory of the 
group SU(2) without reference to tensor network states and algorithms. This review is 
distributed over Sections 5.2, 5.3 and 5.4. We refer the reader to (Cornwell, 1997) and 
Chapters 3 and 4 of (Sakurai, 1994) for additional supporting material for these sections. 
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5.2 Representations of the group SU(2) 

In this section we consider the action of SU(2) on a vector space that is an irreducible 
representation of the group, and then more generally on a vector space V that is a reducible 
representation, namely, V decomposes as a direct sum of (possibly degenerate) irreducible 
representations. We also characterize vectors belonging to V and linear operators acting 
on V that are invariant under the action of SU(2). 

Let V be a finite dimensional vector space on which SU(2) acts unitarily by means of 
transformations Wr :¥—)■¥, 

W = e*""'"^ = e^('^^'^^+^y'^y+^^'^^)_ (5.17) 

Here r = {rx,ry,rz) G M^ parameterizes the group elements and J = {Jx, Jy,Jz)', Jx,Jy 
and Jz are traceless hermitian operators that are said to generate the representation W,. 
of SU(2). These operators close the lie algebra su(2), namely, 

[Ja,J(3]=i J^ ea(3yJy, a,(3 = x,y,z, (5.18) 

■^/=x,y,z 

where ea/s^y is the Levi-Civita symbol. The operators Jx, Jy and Jz are associated, for ex- 
ample, with the projection of angular momentum or spin along the three spatial directions 
X, y and z, respectively. 



It follows that, 



[J2,J„] = 0, J'= 5^ Jl- (5.19) 



a=x,y,z 



5.2.1 Irreducible representations 

Let vector space V transform as an irreducible representation (or irrep) of SU(2) with 
spin j. Here j can take values 0, ^, 1, |, 2, . . . and V has dimension 2j + 1. We choose 
an orthonormal basis \jmj), the spin basis, in V that is a simultaneous eigenbasis of the 
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operators J^ and J^, 

J^ljrrij) =j{j + l)\jmj), 

Jzljrrij) =mj\jmj). (5.20) 

Here rrij is the magnitude of the spin projection along the z direction and can assume 
values in the range {— j, — j + 1, . . . , j}. In this basis, the action of the operators J^ and 
Jy on the space V is conveniently described in terms of the raising operator J_|_ = Jx + iJy 
and the lowering operator J_ = J^ — iJy as 



J±\jm,) = y/j(j + l)-^,K±l)|j, K ± !))• (5.21) 

The operator J^ can be written as 

J2=j(j + l)4+i> (5-22) 

where I2J+1 is the Identity acting on the irrep j. 

Example 1: Consider that vector space V is a spin j = irrep of SU(2). Then V has 
dimension one, V = C. The operators Ja are trivial, Jx = Jy = Jz = (0). I 

Example 2: Consider a two-dimensional vector space V that transforms as an irrep 
i = \- Then the orthogonal vectors (in column vector notation) 

^ b = ^'^| = ^)' (5-23) 

form a basis of V. In this basis the operators Jx, Jy, Jz and J^ read as 

-(;:)■- (17) -(;';) "■(;;) - 

In terms of Pauli matrices a^ we have 

J„ = y, a = x,y,z.t (5.25) 

Example 3: Also consider a three-dimensional vector space V that transforms as an 





70 



Implementation of non-Abelian symmetries I 



irrep j = 1. The orthogonal vectors 
E |j = l,mi = -l), 







1 



= |j = l,"^i = 0), 



/o\ 



VJ 



|j = l,mi = l), (5.26) 



form a basis of V. In this basis, operators j^., jy, Jz and J^ read as 



J X 



J. 



( 







o\ 



1 
^ ^ 

/-I o\ 


VO V 



/ 



, Jy 







V2 



V2 





o\ 

i 
V2 



V -71 0/ 

/2 0\ 

2 0.1 

\0 2y 



(5.27) 



5.2.2 Reducible representations 

More generally, SU(2) can act on the vector space V reducibly, in that, V may decompose 
as the direct sum of irreps of SU(2), 



V 



^. V, 

0(D,®V,). 



(5.28) 



Here space Vj accommodates a spin j irrep of SU(2) and dj is the number of times Vj 
occurs in V. The decomposition can also be re-written in terms of a (ij— dimensional space 
Dj. We say that irrep j is (ij-fold degenerate and that D^ is the degeneracy space. The 
total dimension of space V is given by ^ . (ij(2j + 1). 

Let tj = 1,2, ... ,dj label an orthonormal basis \jtj) in the space Dj. Then a natural 
choice of basis of the space V is the set of orthonormal vectors Ijtjrrij) = \jtj) \jiTij), 
where j assumes various values that occur in the direct sum decomposition, Eq. (5.28). 



In this basis the action of SU(2) on V is given by 



r J ; 5 



(5.29) 
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as generated by the operators 



4 = (4 8) 4„ 



J- I , o X, y, z. 



(5.30) 



Here J^. is a (ij x dj Identity and operators Jaj generate the irreducible represention Wrj 
on space Yj. 

The operator J^ takes the form 



j2^0j(j + i)(4®4+i)- 



(5.31) 



Example 4: Let vector space V transform as an irrep j = \ with a finite degeneracy 
di = 3. The space V decomposes as V = Di Vi where Di is a three-dimensional 

2 2 2 2 

degeneracy space and Vi corresponds to the space of Example 1. 
The total dimension of space V is di (2j + 1) = 6. The vectors 



/A 




/o\ 




(o\ 







= \j=-,to=l), 


1 


^ j=-,to=2), 





^\j=^,ti=3). 


\V 




W 




v) 





(5.32) 



form a basis of Di . A basis of V can be obtained as the product of the the basis (5.32) of 
Di and the basis (5.23) of Vi . In this basis of the operators Ja take the form of Eq. (5.30). 
For instance, 



/l o\ 



J.= 





\ 


1 


® ' 




U 


\Q l) 


\2 



/o I o\ 

i 

I 

0^000 

0^ 

0^0 



(5.33) 
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Similarly, operators jy and j^ read as 



J 1, 



J. 
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r> / 



(5.34) 



The operator J^ reads 



2^2 



+ l)/3 



fl 



^00000 
I 
I 
f 
I 
I 



(5.35) 



Example 5: Consider a five-dimensional Hilbert space V that decomposes into two 
different irreps j = and j = 1 with degeneracy dimensions d^ = 2 and rfi = 1 so that irrep 
j = is two- fold degenerate. The space V decomposes as V = (Dq (X> Vq) © (Di (g) Vi), 
where Dq is the two-dimensional degeneracy space of irrep j = and Di is the one- 
dimensional degeneracy space of irrep j = 1. 
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\j = 0,to = l,"^o = 0), 



|j = 0,to = 2,mo = 0), 



= \j = 1,^1 = l,"^i = -1), 



The orthogonal vectors 

/l\ 




w 

fo\ 

1 




w 

fo\ 



1 



w 

fo\ 




1 
fo\ 





vv 

form a basis of V. In this basis, the operators Ja take the form 

Ja = {ido ® Jafi) © (idi ® Ja,l), a = X,y, Z, 



\j = l,ti = l,mi = 0), 



\j = l,ti = l,mi = 1). 



(5.36) 



(5.37) 



where Ja,o and Ja,i are the generators of irrep j = (Examples 1) and irrep j = 1 
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(Examples 3) respectively. Operators Ja and J^ read as 



J rf 
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(5.3^ 



5.2.3 SU(2)-invariant states and operators 

We are interested in states and operators that have a simple transformation rule under 
the action of SU(2). 

A pure state |^) G V with a well defined spin j belongs to the subspace D^ (8> Vj. In the 
spin basis Ijijirij) the state |^) can be expanded as 



\'^) = J2^'^jhm,\jt,m,), 



(5.39) 
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Under the action of SU(2), |\1/) transforms to another pure state |\1/'), |\l/') = IVrl^), 
within the same subspace Dj (g) Yj. The components {'^'j)t'.m'. of |\&') are related to those 
of |\&) as 

^^ (5.40) 



i^'M-^ 



tiirii 



In case of vanishing spin j = 0, the state |\&) transforms trivially under the action of 
SU(2), Wrj=o = 1. In this case Eq. (5.40) reduces to, 



ly^l^) = 1^), Vr e 



(5.41) 



That is, |\l/) remains invariant under the action of SU(2). Equivalently, it is annihilated 
by the action of generators. 



J«|^) = 0, 



a = x,y, z. 



An SU (2) -invariant state |\E') can be expanded in the basis \j 
spin j = subspace, Dq ® Vq, 



|^)=5^(^o)tob = 0,to,mo = 0). 



to 



(5.42) 
0, to ; '"^0 = 0) of the 



(5.43) 



where we have used (^E'o)to ^s a shorthand for (\E'j=o)to,mo=o- 

A linear operator T : V — t- V is SU(2)-invariant if it commutes with the action of the 
group, 

[f , Wr] = 0, Vr G M^ (5.44) 

or equivalently, if it commutes with the generators Ja, 



[f , Jo] = 0, 



a = X, y,z. 



(5.45) 



Notice that the operator J^ is SU(2)-invariant, Eq. (5.19). 
An SU(2)-invariant operator T decomposes as 



f = (f, g) 4+i) , 



(Schur's Lemma) 



(5.46) 
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where Tj is a dj x dj matrix that acts on the degeneracy space Dj. This decomposition 
imphes, for instance, that operator T transforms states with a well defined spin j [such 
as |\[^) of Eq. (5.39)] into states with the same spin j. Thus, SU(2)-invariant operators 
conserve spin. 

Example 2 revisited: A generic state |\E') G Vi has the form. 



1^) 






/mi = 

3 



/mi = 
2 



ee 



(5.47) 



and is an eigenstate of Ji with eigenvalue -. 

2 4 



According to Schur's lemma, an SU(2)-invariant operator T acting on Vi must be pro- 
portional to the Identity, 



f= iZ 



^=1- 



1 
1 



, r,_i G c. I 

•'~2 



(5.4J 



Example 4 revisited: A generic state |\E') in the vector space V = 3Vi of Example 3 
has the form 



1^) 



A^,= i)ti=l,mi=-A 

(^J=l)ti=2,mi=-i 
^2 2 ^ 

(^j=i)ti=2,mi=| 

'^ 2 2 -^ 

(^j = l)ti=3,mi=-l 

^2 2 ^ 

\^(^,=i)t =3,mi=iy/ 



2 2 "^ 



gC 



(5.49) 



Similar to the previous example, |\E') is an eigenstate of Ji with eigenvalue 
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An SU(2)-invariant operator T : V — )■ V must be of the form 

Til Ti2 Ti3 



T 



( 



T21 

Til 


T21 


Tsi 





T22 T23 
T32 T33/ 





Til 
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T12 
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T12 



T22 



T32 



Tl3 



T23 









Tl3 



T23 


T33 



(5.50) 



where we have used Tij as a shorthand for {Ti)ij G C Notice that J in Eq. (5.35) has 
this form. I 

Example 5 revisited: A generic state \'^) G V, V = 2Vo © Vi has the form 



m 



gC 



(5.51) 



^ (^0)1,0 ^ 
(^0)2,0 
(^1)1,-1 
(^1)1,0 

V (^1)1,1 I 

(For simphcity we have omitted exphcit labels in the subscripts.) In contrast to the 
previous two examples, a generic state |^) G V is not an eigenstate of J^, that is, |\E') is 
generally not a state with a well defined spin j. 
An SU(2)-invariant vector |\E') has the form 



1^) 



V 



n,o 

(^0)2,0 









(5.52) 



/ 



with non-trivial components only in the spin j = subspace. Notice that this state is 
annihilated by the action of the operators Ja [Eq. (5.38)] in accordance with Eq. (5.42). 
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A state with a well defined spin j = 1 must be of the form 



l^i) 






(^i)i,o 



gC^ 



(5.53) 



with non-trivial components only in the spin j = 1 subspace. 



An SU(2)-invariant operator T e.g. J in Eq. (5.38) has the form 
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m)iiy 





(5.54) 



where (T( 



^0)11 7 (^0)12 5 (^0)21 ) (^0)22 ' (^i)ii 



G C. I 



Notice that the SU(2)-invariant vector in Eq. (5.52) and the SU(2)-invariant matrices 
in Eqs. (5. 48), (5. 50) and (5.54) have a sparse structure. In particular, the non-trivial 
components of an SU(2)-invariant matrix T are organized into blocks Tj. This block 
structure can be exploited for computational gain. An SU(2)-invariant matrix can be 
stored compactly by storing the degeneracy blocks Tj, while matrix multiplication and 
matrix factorizations can be performed block-wise [Sec. 5.6] resulting in a significant 
speedup [Fig. 5.26] for these operations. 
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5.3 Tensor product of representations 

So far we have described the action of SU(2) on a single vector space. Let us now consider 
the action of SU(2) on a space V that is a tensor product of L vector spaces, 

L 

V = (g)V('\ (5.55) 

1=1 

where each vector space V*^'-*, / = 1,2,. ..,L, transforms as a finite dimensional represen- 
tation of SU(2) as generated by spin operators Ja ,01 = x,y,z. We consider the action of 
SU(2) on the space V that is generated by the total spin operators. 



L 
Jet = / ^ ^a 1 (^ ^ -^jV} ^} 



1=1 



(5.56) 



(each term in the sum acts as Ja on site / and the Identity on the remaining sites) and 
which corresponds to the unitary transformations, 

L L 

Wr = e^"-' = (g) e'"-'^'^ = (g) W^'\ (5.57) 

1=1 1=1 

As a example consider two vector spaces V*^^^ and V*-'^-' on which the action of SU(2) is 
generated by spin operators Ja and Ja respectively. We can then consider the action 
of the group on the product space V*^^'^-' = V*-"^-* ® V^"^-* as generated by the total spin 
operators Ja \ a = x,y^ z, that are given by 

Similarly, we can consider the action of SU(2) on the product of three vector spaces, 
Y{^)^ Y{s) Q^T^d V*^'"'', that is generated by spin operators Ja , a = x,y, z, 

j(ABC) ^j(A)^f^f^f^j{B)^f^f^f^ jiC)^ ^5_5g^ 

where J a , Ja and Ja are the spin operators that act on the three vector spaces. 

A basis of V can be obtained in terms of the spin basis of each vector space in the 
product, Eq. 5.55. However, it is convenient to introduce a coupled basis: the simultaneous 
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eigenbasis of the total spin operators J^ and J^. In the coupled basis SU(2)-invariant states 

1^) = Wrl"^), Vr G M^ (5.60) 

and SU(2)-invariant operators T : V — ?■ V, 

[f,Wr]=f, VrGM^ (5.61) 

have a sparse structure, namely, |\E') has non-trivial components only in the spin zero 
sector of V while T is block-diagonal [Eq. (5.46)]. 

In the remainder of the section we focus on the tensor product of two representations. 
We first discuss the case where the two sites transform as irreducible representations and 
then the more general case of reducible representations. The tensor product of several 
representations can then be analyzed by considering a sequence of pairwise products. 

5.3.1 Tensor product of two irreducible representations 

Let vector spaces V*^"^^ and V'-^^ transform as irreps Ja and Jb respectively. The space 
Y(ab) jg^ j^ general, reducible and decomposes as 

V(^^)-0v5.^f, (5.62) 

JAB 

where the total spin jab assumes all values in the range 

JAB ■ {\JA - Jb\, \JA - Jb\ + 1, . . . , Ja + Jb}- 

(5.63) 

(Fusion rules) 



Let Ija'itT'a) £ V^^^ and IJb'itT'b) G V*^^^ denote the spin basis of the respective vector 
spaces. Then the vectors 

\JAmj^;3Bmjg) = \JAmj^) ® {jsmj^) (5.64) 

form a basis of Y^^^' . Introduce a coupled basis Ijab^T'Ab) £ V^"^^^ that fulfills 

J^'-'^^^lJABmj^^) = JabUab + l)\JABmj^^), 

Ji^^'^ IjABrrij^^) =mj^^ iJABmj^^). (5.65) 
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The coupled basis is related to the product basis (5.64) by means of the transformation 



\3ABmj^^) = J2 ^j 



JAm-j^ ,jBmjg ^jAB'nij^g 



\jAmj^;JBmjg). 



(5.66) 



Here 



/^ fuse 



{JArrij^ ; Jbtuj^ iJABrrij^^ ) (5.67) 

are the Clebsch-Gordan coefficients, which vanish unless Ja,Jb and jab are compatible, 
that is, Ja,Jb and Jab fulfill 



\JA -Jb\ < JAB < JA + JB, 



and rrij^ , rrijg and rrij^g fulfill 



rn^AB =^JA+^]B- 
The product basis can be expressed in terms of the coupled basis as 



\JAmj^;JBmjg) = ^ C, 



split 



jJABrrij^g) 



where 



/^ split ^ fuse 

JABmj^g^JAmj^,JBmjg = ^ JAmj^,JBmjg^JABm.j^g- 



(5.68) 



(5.69) 



(5.70) 



(5.71) 



We graphically represent tensors C^'^'"' and C^'"' differently from usual tensors, as shown 
in Fig. 5.7(i). 

Tensor Cf"!! , m ^-i . m is depicted by means of two incoming lines and one out- 

JA^'JA^JBT'i'jg^-JABTll'JAB L' J o 

going line that emerge from a point. The outgoing line corresponds to the spin index 
{JAB,fnjAB)- '^^^ incoming lines that are encountered first and second when proceeding 
clockwise from the outgoing line correspond to the spin indices {JA,rnj^) and {JB,mjj^) 
respectively. 

Analogously, tensor C"'^^*^. -s.i^m jsm i^ depicted by means of one incoming line and 
two outgoing lines that emerge from a point. The spin index {Jabi^^jab) corresponds to 
the incoming line in this case while spin indices {ja-, ^^ja) ^"^^ Ub, ^^jb) correspond to the 
outgoing lines in the order in which they are encountered when proceeding counterclock- 
wise from the incoming line. 
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(i) j.m . ; 

^ -^ •'1 Ja Jb 



c 



Jab^,,, 



j.m. jf.m . 



(ii) Iab^,^^ j^^m.^^ (iii) ^'«,, ^'«„ ^'«,,. ^'«,„ 

tfuse 



split 



C 

m 



C*"" 





Jab^^iab 



Figure 5.7 - (i) The graphical representation of the Clebsch-Gordan tensors: C^""^ and C'^''*. 
(ii) Tensors C^"^" and C"'''" are isometries and thus yield the Identity when contracted pairwise 
either as (i) or (ii), Eq. (5.72). 



Tensor (7^""= and tensor (7"^"* fulfill the orthogonality identities, 
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(5.72) 



The special graphical representations for these tensors allows one to depict the above 
identities in an intuitive way, as shown in Fig. 5.7.(ii)-(iii). 

Example 6: Let both vector spaces V*-^^ and V'-^^ transform as a spin | irrep, ja = 
JB = \ (Example 2). The space V*^^^^ decomposes into a direct sum of irreps. 



y(AB) ^ y(A) ^ y(B) ^ yi^AB) ^ ^(AB)_ 



(5.73) 



A basis can be introduced in V*-"^^-* in terms of the spin basis [Eq. (5.23)] of V*-"^-* and of 
V(-^). The coupled basis of V^^-^), 

|JAB = 0,mj^3 =0), 

\3AB = l,mj^B = -1), \JAB = l,"^Mfl = 0), \JAB = l,mj^B = 1), 
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is related to the product basis by means of the Clebsch-Gordan coefficients, 

IJAB = 0,mAB = 0) = Cl"^ ii^gJJA= -,mA= — ;ji3 = -,mij = -) 

,111-1, 

i fuse ' ' ' ^ 



+ Ctri^_JjA = -,mA = -;Jb = -,mB = — ) (5.74) 



2 2'2 2 



2' 2'" 2' 2 



\JAB = l,mAB = -I) = Ct'^^^-i^^_-^\JA = -,mA = —-Jb = ^,mB = —) (5.75) 
\JAB = ^^ruAB = 0) = CiTi_i^^JJA = 2'"^A = -T^-^JB = ^,rnB = —) 

+ Cf^,ii^iobA = ^.rriA = —■,JB = ^,mB = -) (5.76) 

1111 
IJAB = 1,"^AB = 1) = '^\\,\\^ii\^A= ^,mA= -]iB = :^,mB = -). (5.77) 

For completeness, we list below the numerical value of the Clebsch-Gordan coefficients 
that appear in Eqs. (5.74)-(5.77), 
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5.3.2 Tensor product of two reducible representations 

Let us now consider that vector spaces V'-^^ and V''^^ transform reducibly under the action 
of SU(2). We have 

V(^) - (dJ.;^) ® Vj.^)) , V(^) - (Dj.f ) ® \fj) . (5.78) 

JA JB 

The space V*-'^'^'' decomposes into a direct sum of irreps, 

V(-) ^ d,^.v;-' ^ (dJ-' S Vj-)) , (5.79) 

JAB JAB 

where the total spin jab takes all values that are compatible with any pair of irreps Ja 
and JB- 

Let IJa^jaI^ja) ^^^ \iBtjB^^jB) denote the spin basis of V*^^^ and V*^^^ respectively. We 
introduce a coupled basis \JABtjAB^^3AB) ^ V^^-^^ that fulfills, 

^i^^^ \jABtjAsmJAB) = ^3AB \3ABtjAB^JAB)- (5-80) 
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and which is related to the product basis, 

by means of a transformation, 



^.81) 



^-ja'^jb ^ja'^jb 



The components TJ"7 ™ ,; + ^ .,-, ^ ^r, can be expressed in terms of the Clebsch- 



Gordan coefficients as 



'V' fuse X'" fuse /^ fuse 

JAtj^mj^jBtjBrrijg^JABtj^gmj^g — JAt:iA'JBtjB^JABtjAB J^^^JA'^BmjB^JABmj^g ■ 



(5.82) 



Let us explain how this expression is obtained. From the definition, Eq. (5.81), we have 

'^j7t,^mj^,JBtjg7n,g^JABtj^gmj^g = {J ABtjAs'^JABU A'tjA'^JA^ 3 B'tjB'^JB) ■ (5.83) 

According to the direct sum decomposition, Eq. (5.79), each vector iJAstjAB^^jAB) belongs 



JAB ""JAB/ 

„^ , . Mrhprp it faptoriypR ar 

Jab Jab 



to the subspace D^- 0Y) where it factorizes as 



iJABtjABTT^jAs) = iJABtjAs) ® IJAB^TI^ab)- (5-84) 

Similarly, we can factorize vectors iJA^jA^^iA) ^^^ I^b^jb^^jb)- '^^^ expression Eq. (5.82) 
can then be obtained by substituting these factorizations into Eq. (5.83) and re-arranging 
the terms as shown below, 

^ilL "^.4 JBt.^ni.^^JABtj^^m,,^ = {JABtjAB IjAtjA ] htjB ) {JABmj^B I JA"^ja 5 JB^^Jb ) ^ 



"V" fuse /^ fuse 

JAtj^ ,JBtjB ^JABtjAB JA-mj^ JBrrij^ ^JAB-nij^B ■ 



where IjAtjA^jBtjg) = \jAtjA) ® Ijb^js)- 

Here X''"'"' is a one to one map that relates vectors Ijab'^jab) ^ ^j ^'^ ^^^ vectors 
iJAtjA'iJBtjg) G DL^ • It can be regarded as a rank-3 tensor such that each component 



Jab 

of X'"''° is either a zero or a one. We have 



1 if iJABtj^B ) = iJAtjA ; JBtjB ) , 

otherwise . 
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Figure 5.8 - The graphical representations of (i) the fusing tensor T'"'' and (ii) the splitting 
tensor. For fixed values oi ja,Jb and jab each of these tensors factorizes into a X and a C 
tensor. 

The product basis can, in turn, be expressed in terms of the coupled basis. 



IjAtj^mj^^jBtj^rrij^) = J2 Yl ^W, 



J AS ""OAB ^JAtjj^mj^ JBtjg mjg 



\JABtjAB^JAB)^ 



(5.86) 



where 



'Y^ split -y split /^ split 

JAB'tjAB'^JAB^^AtjA^JA^^BtjBmjg " JABtj^g^JAtj^,JBtjg ' JABnij^g^JAmj^jBrn^g- 



and 



"V' split -y fuse 

JABtjAB^^Atj^jBtjg = JAtjj^jBtjg^JABtj^g- 



(5.87) 



(5.^ 



We refer to the tensors T'""" and T'^"' as the fusing tensor and the splitting tensor re- 
spectively, since they will play an instrumental role in fusing and splitting indices of an 
SU(2)-invariant tensor. The special graphical representation of these tensors and their 
decomposition into X and C tensors is shown in Fig. 5.8. Tensors X/"'.'' ,• . , ,• . and 

^ O jAtjj^,3Btjg^3ABtjj^B 

X°^'"j. _j.w, j f ^^^ graphically represented by means of a circle enclosing an arrow 
head and three lines emerging from the circle corresponding to the three indices of the 
tensors. The three lines in the diagrams of X'"'^"" and X'''"'" correspond to the degeneracy 
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indices {JA,tjA)yUB,tjg) and {JAB,tjAB) by using the same assignment rules that were 
introduced for tensors C^""^" and C'"'"''* respectively. Other features of the graphical repre- 
sentation include an arrow head that is placed within the circle to indicate the direction 
of the fusion and a small rectangle, placed on the line carrying the coupled spins, that 
represents a permutation of basis elements. 

We notice that tensor X '""" can be decomposed into two pieces. The first piece (depicted 
as the circle enclosing an arrow head) expresses a basis {\JAtjA]JBtjg = iJAtj^) ® Ijstjg))} 
of D(^-^) as the direct product of the basis {|JAtj^)} of D^^) and the basis {{JBtj^)} of D^^). 
Note that this procedure does not always lead to the set {\JAtjAiJBtjB)} being ordered such 
that states corresponding to the same total spin jab are adjacent to each other within the 
set. However, we require that the basis associated to an index be maintained as such (this 
ensures, for example, that an SU(2)-invariant matrix is block diagonal when expressed in 
such a basis). This ordering is achieved by means of the second piece (depicted as the small 
rectangle): a permutation of basis states {\JAtjA'iJBtjg)} that reorganizes them according 
to their total spin jab, so that they are identified in an one-to-one correspondence with 
the coupled states {|Jab^j,4b)}- In particular, this description of the tensors X*^""" and 
^spiit ^^^ ]^g exploited to multiply together several such tensors, such as in Fig. 5.12(iv), 
in a fast way. 

By construction, a resolution of Identity can be obtained in terms of tensor T*^""" and 
tensor T"""'", as shown in Fig. 5.8(ii)-(iii). 

Example 7: Let vector spaces V'-"^-' and V*^'^-' correspond to the vector space of Example 
4, that is, 

2 2 2 

Y(^) ^ 3Yf ^ ^ of ^ (g) y[^\ (5.89) 

2 2 2 

The space V*^"^'^-' decomposes as 

where, 

Yf ® vf ) = (V^-^^^ © Vl^^)), (5.91) 
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and 



2 2 



(5.92) 

2 2 

Recall that the basis of the l.h.s. and r.h.s. of Eq. (5.91) are related by the transformations 
Eqs. (5.74)-(5.77). Let us now consider how the basis of the l.h.s. and r.h.s. of Eq. (5.92) 
and of Eq. (5.93) are related. In Eq. (5.92), for instance, the vectors 

\jAB = 0,t,,,)eBi''''\ t,,^ = l,2,...,9, 

are related to the vectors 

\JA = ^,tjA'^JB = -, tje)^^ ^0 tjA^tjB = 1' 2, 3, 

in straightforward way by associating the vectors in a one to one fashion in the order in 
which they appear in the respective basis. For example, the change of basis maps the 
vector 



1 1 

\jAB = 0,tj^5 = 1) to \JA = -,tj^ = 1;JB = -,tj^ = 1) 



and the vector 



1 1 

\3AB = 0,tj^^ = 2) to \3A = -,tj^ = 2;jB = -,tj^ = 1) 

and so on. The basis of the l.h.s. and r.h.s. of Eq. (5.93) are related in a similar way. 

This one to one mapping can be encoded into Xj'^^, j^^. ^j^^t by setting the numerical 
value of the following components equal to one, 

'V' fuse "V" fuse "V" fuse 

|l,|l-^01' |l,|2->02' ^|l,|3-s>03' 

"V" fuse \^ fuse "V" fuse 

|2,|l-s>01' |2, §2-5-02' ^|2,|3^03' 

"V" fuse "V" fuse y fuse 

|3,|l-!>01' |3,|2-s.02' "^i3,|3-!>03' 



and 



■y" fuse "V" fuse "V" fuse 

|l,|l-!>ll' |l,i2^12' "^|l,|3^13' 

"V" fuse "V" fuse "V" fuse 

^|2,il-s>ll' "^|2,i2-5.12' ^|2,|3->13' 

"V" fuse \^ fuse "V" fuse ■ 

^|3,il-s>ll' "^|3,|2^12' ^|3,|3^13- " 



Implementation of non-Abelian symmetries I 




hB<i. 




Ja«'j.,."'j„ 



(ii) h',,'",, Jb'i, 



y-^-v- fuse 






JABtjAB'^J.iB tjY 



spl.. JABtUn"'jAR WX^""' 



A' 



Jab'",,. 



\' y/ 



Figure 5.9 - Tensors T'""" and T"'''" are unitary and thus yield the Identity when contracted 
pairwise either as (i) or (ii). 



Example 8: As another example of the change of basis A''"^'', consider that V*^"^-* and 
yC-B) correspond to the vector spaces of Example 3 and Example 5 respectively. That is, 



The space V*^"^'^-' decomposes as 
where 



(5.94) 



(5.95) 

(5.96) 
(5.97) 
(5.98) 

The transformation that relates the bases of l.h.s. and r.h.s. of Eq. (5.96) and of Eq. 5.98) 
is straightforward, we set 
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The basis of the l.h.s. and r.h.s. of Eq. (5.97) can be related by mapping the three vectors 

|jAB = l,t,^, = 1,2,3) gdS^^\ 



5.4 Review: Fusion trees 89 



in a one to one manner, to the two vectors 



«(^)^^(^)^ 



\JA = l,t,^ = l]]B = 0,t,^ = 1,2) G (D^" ^^1 ;, 

and the vector 

\jA = 0,t,^ = l;jB = l,t,, = 1) G (Dj^) ® D^^)). 
This is encoded into X*"'° by setting 

■y" fuse 'y fuse \/^ fuse -1 ■ 

^02,ll-!>12 ~ ^11,11^01 ~ ^11,11^13 — J-. ■ 

5.4 Review: Fusion trees 

When considering the tensor product of more than two representations one can obtain 
several coupled bases of the product space. These correspond to taking the product of 
the vector spaces according to different sequences of pairwise products. The spaces are 
linearly ordered in a given way and we only consider a pairwise product of 'adjacent' 
spaces in this linear ordering. For example, when considering the tensor product of three 
representations, 

one can consider either the pairwise products 

^{ABC)^^{D)^y(C)^ (5.100) 

or the pairwise products 

^(ABC)^y[A)^y(E)_ (5.101) 

Considering the tensor product one way or the other leads to two different coupled bases 

inV(^^^). 

More generally, there exist several choices of a coupled basis in the tensor product of 
L representations, Eqs. (5.55)-(5.57). A useful way to specify a particular sequence of 
pairwise products is by means of a fusion tree. 
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Figure 5.10 - Examples of two fusion trees r and r' that describe two different ways of 
considering the tensor product of (i) three vector spaces V*-'^\V^^' and V^*^^ and (ii) four 
vector spaces V^^^, V^-^^ V^"^) and V^^^. Fusion proceeds from top to bottom. 

A fusion tree, denoted r, is a directed trivalent tree such that each node of the tree 
represents the tensor product of two incoming spaces into the outgoing space. The tree 
has a total of L + 1 open hnks which correspond to the L vector spaces V^^^ , V*-^^ , • • • , V*^'^-' 
and the product space V. The internal links correspond to the intermediate product spaces 
that appear in a sequence of pairwise products. Figure 5.10 illustrates two different fusions 
trees r and r' that correspond to two different ways of considering the tensor product of 
three and of four representations. The sequence of fusions proceeds from top to bottom. 
A fusion tree can also be specified as a list of fusions. For example, the fusion trees r and 
t' depicted in Fig. 5.10(i) can be specified as 

T = {A,B ^D;D,C ^ (ABC)}, 
t' = {B,C ^E-A,E^ (ABC)}. 

Fusion trees play an important role in our discussion. In the present context, a fusion 
tree characterizes a coupled basis of a tensor product space. In Sec. 5.5 fusion trees are 
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also used to characterize different canonical decompositions of an SU(2)-invariant tensor. 

In the remainder of the section we consider coupled bases that are labeled by different 
fusion trees. We define the unitary transformation that relates two such coupled bases. 
This transformation is important since it also relates two different canonical decomposi- 
tions of an SU(2)-invariant tensor, as discussed in Sec. 5.5. For purpose of illustration, 
we first characterize the coupled basis in the simple case of the tensor product of three 
representations before proceeding to the generic case of L representations. 

5.4.1 Tensor product of three irreps 

Let vector spaces V'^^^ V^^-* and V*^*"^ transform as irreps Ja,Jb and jc respectively. The 
space V*^^^'"-' is in general reducible, and may contain several copies of an irrep Jabc- Let 
us first consider the sequence (5.100) of tensor products corresponding to a fusion tree r. 
The vector spaces V^'^-' and V'-'^'^*"^ decompose as 

V(^)^0V5.J\ (5.102) 

JD 

and 

JABCJD 

Notice that we can use the values of jd that appear on the r.h.s. of Eq. (5.102) to label 
different copies oi jabc that appear on the r.h.s. of Eq. (5.103). Thus, a coupled basis of 
Y(abc) pg^j^ ]^g labeled as Ij^scmj^^^; r; j^)- 

^^* ^^]AJBJcJABc^^:iA"^OB"'Jc"'oABc ^^^^^^ ^^^ trausformatiou from the product basis 
iJArrij^) O iJBfTijg) (g) Ijcmjc) to the coupled basis iJABcmj^g^^r-jD)- This change of 
basis can be expressed in terms of Clebsch-Gordan coefficients as 

(f)^D \ -- \ ^ n fuse . /^fusc 

^^JAJBJCJABC'^JA^JB'^JC^JABC ~ 2-^ JAmjj^JBmjg^JDmj^ jomj^^Jcmj^^JABcmj^g^y 

(5.104) 

where CJj^. j^^. _^,-^„, relates the basis \JA-,mj^) ® \JB-,mjg) to the intermediate 
basis hum,- ), and C/"''° . ™ ,,• „^ relates this intermediate basis to the coupled 
basis \JABcmj^gc'iT]JD)- 
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Figure 5.11 - (i) In the tensor product of three irreps, two coupled bases that are labeled by 
fusion trees r (5.100) and t' (5.101) are related to one another by means of the recouping 
coefficients .F^^/^- ■ . (ii) A recoupling coefficient is given as the 'scalar product' of Q and 
Q'. 



Alternatively, we can first consider the tensor product V^-^) (g) V*^*"-* (corresponding to the 
sequence (5.101) of tensor products characterized by another fusion tree r'), 

V(^) ^ V(^) ® V(C) ^ Vj.f , (5.105) 



]E 



and use irrep Je to label another coupled basis \iABC^^jABc'^'''''^JE) of V^'^^*"^ Denote by 



{Q 



IJE 



Clebsch-Gordan coefficients we have 



the change of basis to this new coupled basis. In terms of 



{Q 



fJE \ —- \ ^ r^ fuse /^ fuse 

OAJBicJABCl'^iA^iB^^c'^iABC ~ A^ JBmjgJcmj^^JEmjj^ ' ^JAmj^,JEmjj^^JABCmjj^g^- 



(5.106) 
The two coupled bases \3ABCfnjj^j^(.\ r; jd) and |Jabc"^jasc5 ''"'5 ^e) are related by a trans- 



formation that is given by a rank-6 tensor F with components Fl°l^- ■ , 
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(5.107) 
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Here ^j^j^j^jabc ^^^ ^^^ recoupling coejficients {CoiuweW, 1997) of SU(2). By using 
Eqs. (5.104) and (5.106), the recoupling coefficients can be explicitly expressed in terms 
of Clebsch-Gordan coefficients, 

pJDJE ^ y 

JAJBJCJABC 2JABC + 1 



Ej /^ fuse /^ i 



1 fuse 

^:)Am-i^ jB-nijj^ -^jorrij^ ^ jorrij^ ,jcm.j^ -^JABCmj^g^ 



iBmjg,Jcmjf^^JEmjj^^JDmj^,jcmj^^JABcmj^g^ J ' yu.i^KJu; 

where m = {mj^,mjj^,mj^,mjg,mj^,mj^g^}. Notice that, since the m's are summed 
over, the recoupling coefficients depend only on the j's. Also recall that the recoupling 
coefficients are proportional to the 6-j symbols of the group, 

f1a^:.o.abc = « r.^ .'" '." 1 ' (5-109) 

[ 3c JABC JE J 

where 

a = (-l)(J^+Js+ic+iAsc)^(2j^ + 1){2je + 1). (5.110) 

5.4.2 Tensor product of three reducible representations 

Consider the action of SU(2) on the space V'-'^'^''^ 

where V*^^-* , V^'^-' and V*^*"^ are reducible representations of SU(2). It induces a decompo- 
sition 

v'^'"^'^e(»LT®v;-f), (5.111) 

JABC 

where Jabc takes all values that are compatible with any Ja,Jb and jc- 

Extending the argument for irreps, we can relate the coupled basis of V^"^'^*"-' to the 
product basis by ffist considering the sequence (5.100) of tensor products and using two 
ytusc ^g]2sors 

'Y^ fuse 'Y^ fuse / r I T 0\ 

^a,b^dj ^ d,c^{abc) yo.iiz) 
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to relate at each step the coupled basis with the product basis. Alternatively, we can 
consider the sequence (5.101) of tensor products and use the different set of fusing tensors 

'Y^ fuse "Y^ fuse fr 1 1 Q\ 

^ B,C^E^ ^ A,E^{ABC) [O.llO) 

to relate the product basis to the coupled basis at each step. The respective change of 
basis transformation for the two cases is depicted in Fig. 5.12(i). 

The two coupled bases, so obtained, are related by means of a matrix T that decomposes, 
according to Schur's Lemma [Eq. (5.46)] as 



JABC 



(5.114) 



where the components of Dj^^gc can be expressed in terms of recoupling coefficients. This 
decomposition can be derived as follows. 

The matrix T is obtained by contracting the tensor network made of tensors T'"''° and 
tensors T'^'" that is shown in Fig. 5.12(ii). This contraction can be performed piecewise 
[Fig. 5.12(iii)]. For fixed values of j's on all links the tensor network factorizes into two 
pieces since each constituent tensor T'"""" and tensor T"""'" factorizes into a X and a C 
tensor. The tensor network made of C tensors equates [Fig 5.11(ii)] the Identity times 
the recoupling coefficient ^j^jgjf^jj^g^' "^^^ niatrix Dj^^^ in Eq. (5.114) is then defined as 

f) = '^ F^'^ D'^^ ('^1151 

^JABC — /_^ ^ JAJBJCJABC JAJBJCJABC^ <^0 . L LO J 

JAJBJCJDJE 

where D'j^^^j^j^^^ denotes the matrix that is obtained by contracting together the X 
tensors. Here the sum is over all values oi ja,Jb,Jc,Jd, and Je that are compatible with 
a given value of Jabc- 

5.4.3 Tensor product of L irreps 

In a similar way, we can consider the tensor product of four irreps; different choices of 
a coupled basis, corresponding to different fusion trees, are related by the 9 — j symbols 
and so on. 
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Figure 5.12 - (i) The change of basis from the product basis to two different coupled bases in 
the fusion of three reducible representations is given in terms of two fusing tensors, (ii) The two 
coupled basis are related by means of the matrix F [Eq. (5.114)] that is obtained by contracting 
a tensor network made of tensors T'"'" and tensors T'''''". (iii) The components of T are given 
in terms of recoupling coefficients. This can be seen by performing the contraction piecewise. 
For fixed values of spins Ja,JBtJC:JabC:Jd and je the tensor network decomposes into a 
tensor network made of X tensors and a spin network. The former is contracted to obtain 
a matrix D' whereas the latter can be replaced by the Identity I2jabc+^ ^"^ ^ recoupling 
coefficient [Fig. 5.11(ii)]. 

More generally, let us consider the tensor product of L representations, Eq. (5.55), where 
each space V*^'-* (/ = 1, 2, . . . , L) transforms as an irrep j/. A coupled basis can be labeled 
by a fusion tree r and the set of intermediate irreps jei , je2 ) • • • ) jez that are assigned to 
the internal links of r. We denote by 



\jmj;T;je,...Jez) e V 



(5.116) 



such a basis. By attaching the appropriate Clebsch-Gordan tensor C**"^'' to each node of 
T and contracting the resulting tree tensor network we can obtain tensors 



^S.:^^(-) 



(5.117) 
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Figure 5.13 - The spin network that relates two coupled bases labeled by fusion trees r and 
r'. The spin network is proportional to the Identity, the proportionality factor is the coefficient 
Sl^''/''f'l^ ,, which can be shown to be the product of two recoupling coefficients. 

3A3B3C3D3' "^ r- to 

that mediate the change from the product basis to this coupled basis. 

Another coupled basis |jmj;r';j/j ■■■jfj corresponding to a different fusion tree r' is 
related to the basis (5.116) by the transformation 



Qt:ii''('r'' 



'J1---J-L 






>zJ/i-J/z(^^^/)gi^i-^>z, 



JL 



(5.118) 



where the coefficients Sj"^^","^ ^^"' ■^^(t,t') can be expressed in terms of the recoupling 



coefficients [Eq. (5.107)]. 



As an example, consider two different ways of coupling four spins Ja,Jb,Jc and jo ac- 
cording to the fusion trees r and r' that are shown in Fig. 5.10(ii). The two coupled 
bases are related by coefficients Sj^j^j'^j"j{t, t') that are defined according to the equal- 
ity depicted in Fig. 5.13. Note that the tensor network made of Clebsch-Gordan tensors, 
shown in Fig. 5.13, is an instance of a spin network. In this case, the spin network has two 
open links and can therefore be regarded as an SU(2)-invariant operator. The equality in 
the figure then simply depicts that the spin network is proportional to the Identity. The 
numerical value of the coefficient Sj'^j^j^j"j{t,t') can be calculated without contracting 
the spin network, but by instead following a procedure called evaluating a spin network. 
Section 5.7 illustrates with simple examples the procedure to evaluate a spin network 



corresponding to a generic coefficient S*-^ 



Jej ■■■]e.z3fi ■■■3fz 
jkj 



't,t'). For instance, it is shown that 
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Figure 5.14 - The transformation f that relates two different coupled bases, labeled by 
fusion trees r and r', when fusing four reducible representations. Matrix F decomposes into 
a degeneracy matrix JDj and the Identity. 



^uT'^^-T i^"^^ r') can be expressed in terms of two recoup ling coefficients, 



cJeJfJgJh t l\ 

JAJBJCJDJ^ ' ^ 



rpjEjG pjFjH 

JAJBJCJF JEJCJDJ ■ 



(5.119) 



5.4.4 Tensor product of L reducible representations 

Finally, consider the tensor product of L reducible representations. A coupled basis, 
labeled by a given fusion tree, is related to the product basis by means of a transformation 
that is obtained by attaching a tensor T*"'° to each node of the fusion tree, and contracting 
the resulting tree tensor network. 

Two different choices of a coupled basis, corresponding to two different fusion trees r and 
t', are related by a matrix T{t, t'). The matrix T{t, t') is a generalization of the matrix 
with the same name that appears Eq. (5.114). This matrix is obtained by contracting a 
tensor network [e.g. Fig. 5.14] made of tensors T*"'° and tensors T'^'". 

For a fixed value of the total spin j, matrix T(t, t') decomposes in terms of degeneracy 
matrices Dj. The components of the latter can be expressed in terms of recoupling 
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coefficients by generalizing Eq. (5.115). We obtain, 

D^ = Y.^t:t'''''"''^t:i:7^ (5-120) 

where the sum runs over all spin labels but excluding j. 

5.5 Block structure of SU(2)-invariant tensors 

In this section we consider tensors that are invariant under the action of the symmetry. 
We explain how such tensors decompose into a compact canonical form which exploits 
their symmetry. The canonical form can be understood as a block structure in the tensor 
components. In Sec. 5.6 we then adapt the set V of primitive tensor network manipulations 
to work in this form. With the formalism of SU(2)-invariant tensors at hand we then 
consider tensor network decompositions made of SU(2)-invariant tensors in Sec. 6.1. 

5.5.1 SU(2)-invariant tensors 

Consider a rank-fc tensor T with indices {^,^2, • • • i^k} and directions D. Each index ii 
is associated with a vector space V'-'-' on which SU(2) acts by means of transformations 

Also consider the action of SU(2) on the space V = (S)i=i V''''' given by 

Y}^^®Y^^^®...®Y}''\ (5.121) 

where 

. ,,, \ W^'^ * if D{1) = 'in' , 

y}'^={ ^a) - 5.122 

[ WP if D{1) = 'out' . 

(Wr * denotes the complex conjugate of Wr .) That is, Yr acts differently depending 
on whether index ii is an incoming or outgoing index. We then say that tensor T is SU(2) 
invariant if it is invariant under the transformation of Eq. (5.121). In components we 
have 

(5.123) 






ll,l2,...,lk 
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for all r e M^. 

In the remainder of this section we explore the consequences of the constraints in Eq. (5.123). 
The main result is as follows. By writing each index ii of the tensor in a spin basis, 
k = {Jhtjn''T^ji)j the tensor is revealed to have a block structure, namely, the non-trivial 
components are organized into blocks that are supported on orthogonal subspaces. For 
a given value of spin ji, the index ii splits into a degeneracy index {ji,tj^) and a spin 
index {ji,mj^). An SU (2) -invariant tensor T decomposes into a set of degeneracy tensors, 
denoted by P and carrying all the degeneracy indices, and a set of structural tensors, de- 
noted Q, carrying all the spin indices. The degeneracy tensors contain all the degrees of 
freedom and correspond to the 'blocks' alluded above. On the other hand, the structural 
tensors are completely determined by the symmetry since they can be factorized into a 
trivalent tree tensor network made of Clebsch-Gordan coefficients. Examples of structural 
tensors include Eq. (5.117), however, a structural tensor may not generally decompose 
according to a fusion tree. We refer to the decomposition (P, Q) as the canonical decom- 
position or the canonical form of tensor T. The main benefit of the canonical form lies 
in the fact that T can be specified compactly by means of only the degeneracy tensors. 

In the ensuing discussion we describe the canonical decomposition of SU(2)-invariant 
tensors on a case by case basis. We explicitly describe the canonical form of SU(2)- 
invariant tensors with one to three indices. The canonical form in these cases is unique 
up to overall numerical factors. On the other hand, an SU(2)-invariant tensor with four 
or more indices can be decomposed in several equivalent ways. We illustrate this with 
examples without resorting to a complete theoretical characterization of the canonical 
form in all cases. A more rigorous characterization is developed Chapter 6 where we 
consider a special canonical form of SU(2)-invariant tensors, namely, tree decompositions. 
A tree decomposition corresponds to decomposing both the degeneracy tensors and the 
structural tensors according to a fusion tree. We find this decomposition more convenient 
from an implementation point of view. In Chapter 6, we also describe how to construct a 
tree decomposition for any SU(2)-invariant tensor, how two different tree decompositions 
of the same tensor are related to one another, and how primitive tensor manipulations 
are adapted to tree decompositions. 
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Figure 5.15 - Implication of the symmetry constraints fulfilled by a rank-1 SU(2)-invariant 
tensor with (i) an outgoing index, and (ii) an incoming index. The only allowed spin on the 
one index is j = 0. 

5.5.2 One index 

An SU(2)-invariant tensor T with an outgoing index a fulfills the constraint [Fig. 5.15(i)] 

{^)a' = J2(^r)a'aWa, (5.124) 

a 

where W^ is the representation of SU(2) on the vector space associated to index a. 
Let us now write index a in the spin basis a = (j, tj, rrij) = (0,to;0). Then we have 



Ta = (P) 



to' 



(5.125) 



where {P)to, shorthand for (Tj^=o)io,mo=o, encodes the non-trivial components of T. Since 
the only relevant irrep on the one index is j = the structural tensors are trivial. There- 
fore, tensor T can be stored compactly as P. 

On the other hand, an SU(2)-invariant tensor T with an incoming index a fulfills 

(Vl/),, = J2i^:)a'ama, (5.126) 

a 

or equivalently 



ma' = J2(^)a{WX'a, 



(5.127) 



where W* and W} are the complex conjugate and adjoint of Wr respectively. The canon- 
ical form of T is the same as that stated as Eq. (5.125). 
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5.5.3 Two indices 

An SU (2) -invariant matrix T, possibly rectangular, with indices a and h fulfills [Fig. 5.16(i)] 

ab 

= V(iyf)) f^Aw^^A , (5.128) 

•^■"^ V / b'b V / aa' 

ab 

where Wr and Wr are the representations of SU(2) on the vector space associated to 
index a = {ja,mj^,tj^) and b = {jh,mj^,tjj respectively. Schur's Lemma establishes that 
the matrix T decomposes as 

{T)ab = {Pjah)tjjj,^jajb^mj^m,^, (5.129) 

which can also be written in a block-diagonal form, 

j 

= 0(P,®/,). (5.130) 

j 

Here the sum is over all values j of spin ja that are equal to a value of spin jb. 

A rank-2 SU(2)-invariant tensor T with both incoming indices a and b is associated with 
fusing spins ja and jb into a total spin 0. It fulfills [Fig. 5.16(ii)] 

ab 
ab 

and decomposes as 



iT)ab - (-PiaiJt,,ij,C'jrmj„,J6m,^^00- (5.132) 

Similarly, a rank-2 SU(2)-invariant tensor with both outgoing indices a and b fulfills 
[Fig. 5.16(iii)] 

f..'-E{^y')J^^r%t. (5.133) 

ab 
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Figure 5.16 - Implication of the symmetry constraints fulfilled by rank-2 SU(2)-invariant ten- 
sors as resulting in the decomposition of the tensors into degeneracy tensors P and structural 
tensors. 



and decomposes as 



\T)ab — \.Pjajb)tja-tji,^r' 



Ja*jft ^OO^jamj^ Jbiriji^ ■ 



(5.134) 



Both incoming (or both outgoing) spins ja and jb are compatible with the total spin 
only for values j of spin ja such that ja = jb = j and for values m of rria such 



that rrij^ 



m 



lb 



m. Therefore, we can recast the canonical decompositions of 



Eqs. (5.132)-(5.134) in a block-diagonal form, 



0(p,®c:;,;, 



(5.135) 



where Uj is a (2j + 1) x (2j + 1) reverse diagonal matrix with diagonal components 



/,", \ ;^ /^tuae ^ split - 



(5.136) 



To summarize, the canonical form of a rank-2 SU(2)-invariant tensor reads 

T = ®{P,®Q^. (5.137) 
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Here Pj contains the degrees of freedom of T that are not fixed by the symmetry, namely, 
Pj transforms trivially under the action of the SU(2), Eq. (5.29). On the other hand Qj 
is determined by the symmetry according to the directions D of indices a and 6, 



Q, 



if Z3 = {'in', 'out'} or {'out', 'in'}. 



Cjj iiD = {'in', 'in'} or {'out', 'out'}. 



(5.138) 
(5.139) 



Thus, a rank-2 SU(2)-invariant tensor T can be stored compactly as 



{{a = {ja,tj,,mjj,b= {jb,tj^,mjJ},D,{Pj}}. 



(5.140) 



Example 10: Consider a rank-2 SU(2)-invariant tensor T with both outgoing indices and 
with each index associated to the vector space V of Example 8, V = Vq © 3Vi © V2. 
Tensor T has the canonical form 



t = (Po © UJo) © (A © tUi) © (A © W2), 



(5.141) 



where 



Uo = 1, 



Ui 



UJ2 



(0 





1 \ 







1 

V3 





5 


Vts 





oj 




/o 




















1 

V5 








1 

V5 








1 








1 


















(5.142) 



The total number of complex coefficients contained in tensor Tis|T| = 15xl5 = 225. 
However, the tensor can be stored compactly as 



{{a, 6}, {'out', 'out'}, {Po, A, A}}, 
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where the total number of complex coefficients that are contained in tensors Pq, Pi and 
A is 

|Po| + lAl + lAl = 1 X 1 + 3 X 3 + 1 X 1 = 11. (5.143) 

Therefore, by exploiting the symmetry the number of coefficients that need to be stored 
is twenty times smaller. I 

5.5.4 Three indices 

Consider a rank-3 SU(2)-invariant tensor T with incoming indices a and b and outgoing 
index c. It fulffils [Fig. 5.17(i)] 



abc 
abc 

where Wr , Wr and Wr are the representations of SU(2) on indices a = {ja, fnjai'^ja)i ^ - 
{ji,,mj^,tj^) and c = {jc,mj^,tjj respectively. The Wigner-Eckart theorem establishes 
that T decomposes as 

[Tjabc = {"jajbjc)t.jjj^tj^(^j^mj^j^mjj^^jcm.j^- (5.145) 

That is, for compatible values of the spins ja,jb and jc, tensor T factorizes into tensor 
^jajbjc containing degrees of freedom and a Clebsch-Gordan tensor that mediates the 
fusion of spins ja and jb into spin jc. 

An SU(2)-invariant tensor T with another combination of incoming and outgoing indices 
has a canonical decomposition that differs in the Clebsch-Gordan coefficients. For exam- 
ple, if T is an SU(2)-invariant tensor with incoming indices b and outgoing indices a and 
c then it fulfills 



abc 
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Figure 5.17 - Examples of the constraints fulfilled by rank-3 SU(2)-invariant tensors and their 
implication as resulting in the decomposition of the tensors into degeneracy tensors P and a 
Clebsch-Gordan tensors. 

and decomposes as 



\i- )abc (^Jajbjc)tja'tjt'^3c'^jbmj.-^jamj^,jcmj, 



'■3b -"^ ^a^Jcii''3c 



(5.147) 



More generally, a rank-3 SU (2) -invariant tensor with any combination of incoming and 
outgoing indices decomposes as 



{T)abc - {Pj, 



XQu 



JajbjcJtjJj^tj^ WjajbjcJrrij^mji^mj^ ■ 



(Wigner Eckart Theorem) 



(5.148) 



The block structure can be made more explicit by recasting Eq. (5.148) as 



' 3a]b]c1 



jajbjc 
= kj) y^jajbjc ® QjajbjcJ 



JaJbJc 



(5.149) 



where we use the direct sum symbol to denote that the different tensors Tj^j^j^ are 
supported on orthonormal subspaces of the tensor product of the spaces associated with 
indices a,b and c, and where the direct sum runs over all compatible values oi ja,jb and 
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jc- The components {Qj^ 



/^ fuse 
/~i fuse 

r^ fuse 

/^ split 
/^ split 

X^ split 

0/~1 split 
Qf^ fuse 



are determined by the directions D of the indices, 



where /3 = (-l)>-Jf+™=^2jc + 1. 



if D = {'in', 
if Z3 = {'in', 
if D = {'out' 
if Z3 = {'out' 
if D = {'out' 
if Z3 = {'in', 
if D = {'out' 
if Z) = {'in', 



in', 'out'}. 



out 



'out' 



out 



'in'}, 
'in'}, 
'out'}, 

, 'in'}, 
'out'}. 



'out', 'out'}, 
in', 'in'}. 



(5.150) 
(5.151) 
(5.152) 
(5.153) 
(5.154) 
(5.155) 
(5.156) 
(5.157) 



To summarize, a rank-3 SU(2)-invariant tensor T can be stored in the most compact way 
as 

{{a,6,c},D,{4,,,J}, (5.158) 

where the indices a, b and c are specified in the spin basis, 

« = (Ja, tj^,mjj, b = {jb, tj^,mjj, c = (jc, tj^,mjj. (5.159) 



Example 11: Consider a rank-3 SU(2)-invariant tensor T such that each index, a, b and 
c, is associated to the vector space V of Example 8. Tensor T can be stored by storing 
the degeneracy tensors, 

-Po,0,0) -Po,l,l' -^0,2,2! Pl,0,li -^1,1,0) -Pi, 1,1) -Pi, 1,2; 
-Pl,2,l5 -Pi, 2,2, -^2,0,2, -^2,1,1, -^2,2,0, -^2,2,1, -^2,2,2, 

corresponding to all compatible values oi ja,jb and j^. 

The total number of complex coefficients that are contained in the degeneracy tensors is 
y \Pjajbjc\ = 45, whereas \T\ = \a\ x \b\ x \c\ = 15^^ = 3375 components; the reduction 

jajbjc 

in the number of coefficients is seventy-five times, much greater than that computed for 
rank-2 tensors in Example 10. In general, the sparsity of SU(2)-invariant tensors increases 
with increasing number of indices. I 
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Figure 5.18 - Two equivalent canonical decompositions of a rank-4 SU(2)-invariant tensor 
corresponding to two different ways of fusing the three incoming indices into the outgoing 
index. 

5.5.5 Four indices 

A rank-4 SU(2)-invariant tensor may be decomposed in several ways in terms of degener- 
acy tensors and structural tensors in correspondence with the existence of different fusion 
trees for four spins. 

Consider a rank-4 SU(2)-invariant tensor T with incoming indices a = {ja,tj^,mj^),b = 
{jb,tj^,mjj and c = {jc,tj^,mjj and outgoing index d = {jd,tj^,mjj. It fulfills 

t... ^ E (^^-^'-i,/- {^^-"L (>^.'^')1 (*''")L ("«) 

abed 

where Wr , Wr , W} and Wr are the representations of SU(2) on the indices a, 6, c 
and d respectively. Tensor T decomposes as 

(T)abcd = /.^{"jajtjcjJiWtjb^jc-tjd ' ^'^ j'ajbjcjJ'^3a"^n"^jc"^Ja^ (5.161) 

where the sum is over all values of the intermediate spin j^. 

The coefficients {Qf,j^j,jjmj^mj^m,^mj^ [Eq. (5.104)] mediate the fusion of the spins ja,jb 
and jc into a total spin jd according to a fusion tree, for example, ffist fusing ja and jb 
and then fusing the resulting spin with jc- 

Alternatively, tensor T can be decomposed as 

[Tjabcd = X^iPjajbjcjJijJjb^jJjd ' y^ jajbjcjJ'^Ja^Jb'n^jc^Jd^ (5.162) 
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in terms of different structural coefficients {Qj^jf,j^jjmj^mj nij^nij [Eq- (5.106)] that are 
associated with fusing the spins according to a different fusion tree, namely, fusing spin 
ia with the spin obtained by first fusing jf, and jc- 

Since Eqs. (5.161) and (5.162) represent the same tensor T, the tensors P and P' are 
related by 

jajbjcjd / J jajbjcjd jajbjcjd'' ^ ' 

where Fj^j[j^j^ are the recoupling coefficients [Eq. 5.107]. 

5.5.6 k indices 

Finally, consider a rank-fc SU(2)-invariant tensor T with all outgoing indices and which 
fulfills Eq. (5.123). By writing each index in a spin basis, ii = {ji,tj^,mji), tensor T can 
be decomposed as 

Here tensor Q,!^^ , "' [Eq. (5.117)] is a transformation characterized by a fusion tree r 
whose internal links are decorated by the spins {je^ , . . . , je; } • Another canonical form of 
the tensor T, 

^^ \ / t,, ...tj, \ / m,-, ...rrti, 

" 'j' ■■■]' " 'j' ■■■f 

comprises of different degeneracy tensors Pj-^^j "' and different structural tensors Q,'^^ ■ ''' 
where the latter is a transformation characterized by another fusion tree r'. 

The two canonical forms, Eq. (5.164) and (5.165), are related as 

Ptt'= E sZT'''--'''ir.r')P^t\ (5.166) 



Jei-.-Je^ 



/ o/ 



^3c\ •••Je.iJe-i ■■•3 



where the coefficients Sj^]j^ ' "^ "'{t^t') are those which appear in Eq. (5.118). 

Thus tensor T can be compactly stored as 

{{^i,^2,...,^4,T,A{i^:i-f'}}. (5.167) 
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For an arbitrary combination of incoming and outgoing indices of the tensor, the canonical 
decomposition is characterized by intermediate spins jei • • • jei that are assigned to the 
links of a trivalent tree that is more general than the fusion tree. Furthermore, two 
canonical decompositions are related by means of more generic spin networks than those 
considered (See Section 5.7) for evaluating the coefficients 3^"^]^^"' "^ "' (r, r'). A rigorous 
result is presented in Chapter 6 where we describe the generic transformation that relates 
two tree decompositions of an SU(2)-invariant tensor. 



5.6 Manipulations of SU(2)-invariant tensors 

In this section we consider manipulations of SU(2)-invariant tensors that belong to the 
set V [Sec. 5.1.5] of primitives: reversal of indices, permutation of indices, reshaping of 
indices and matrix operations (matrix multiplication and matrix factorizations) . We will 
adapt these manipulations to the presence of the symmetry by implementing them in such 
a way that the canonical form is maintained. 

Our approach will be to describe the basic transformations that are instrumental in im- 
plementing the symmetric version of these manipulations and demonstrate their use with 
simple examples. A more rigorous treatment of adapting the primitive tensor manipu- 
lations for SU(2)-invariant tensors is presented in Chapter 6. The basic transformations 
are symmetry preserving and can be described by means of specical SU(2)-invariant ten- 
sors. Consequently, a symmetric manipulation decomposes into the manipulation of the 
degeneracy tensors and the manipulation of the structural tensors. Computational cost 
is incurred only by the manipulation of degeneracy tensors. On the other hand, the 
manipulation of structural tensors can be performed algebraically by applying relevant 
properties of Clebsch-Gordan coefficients. This fact is responsible for obtaining compu- 
tational speedup from exploiting the symmetry. 



no 
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Figure 5.19 - (i) Graphical representation of the cup tensor. For simplicity, we choose the 
same graphical representation for a cup tensor applied to an index that carries a single spin 
j as well as for one that is applied on an index i that carries several spins j (possibly with 
degeneracy dj). (c = 2j + 1 is a normalization constant.) (ii) The analogous graphical 
representation of the cap tensor, (iii) Multiplying together a cup tensor and a cap tensor 
yields the Identity. 



5.6.1 Reversal of indices 

An index i = {j,tj,mj) of an SU(2)-invariant tensor can be reversed by means of the 
'cup' and 'cap' transformations. The cup transformation is given by a rank-2 SU(2)- 
invariant tensor Cl"'^'^ with both incoming indices. It can be used to reverse an outgoing 
index. Analogously, the cap transformation is given by a rank-2 SU(2)-invariant tensor 
Cl"'^'^ with both outgoing indices and can be used to reverse an incoming index. 

In the canonical form, the cup and cap tensors read as block-diagonal matrices. 



j 



(5.168) 
(5.169) 
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Figure 5.20 - Reversing an index of an SU(2)-invariant tensor by means of a cup tensor, (i) 
Reversing an index of an SU(2)-invariant tensor T with two outgoing indices to obtain a matrix 
T' . (ii) The reversal in {i) as performed on the canonical form of T. The degeneracy index 
can be reversed without affecting the components of the degeneracy tensor P. The reversal 
of the spin index equates to replacing the shaded region with a Clebsch-Gordan tensor and a 
numerical factor 2^, which is absorbed into P to obtain P' . (iii) Reversing an index of a 
rank-3 SU(2)-invariant tensor, (iv) The reversal in (iii) as performed on the canonical form 
of T. The reversal of the spin index equates to replacing the shaded region with a Clebsch- 
Gordan tensor and a recoupling coefficient F^"--'^ . The recoupling coefficient appears as a 
result of introducing a resolution of Identity [Fig. 5.7(iii)] on the spins j;, and ja and then 
simplifying the resulting diagram by applying the equality in Fig. 5.11(ii). 



where dj = \tj\ and where 



fi;- = ^2j + Wj, 



fi;- = (-i)^V2j + ic:'. 



(5.170) 
(5.171) 



Here Uj is the tensor defined in Eq. (5.136). By definition, the cup transformation inverts 
the action of the cap transformation and vice- versa, 



^^cup ^^cap 



^^cap ^^cup 



hj+i- 



(5.172) 



Reversal of index i of tensor T can be decomposed into the reversal of the degeneracy index 
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{j,tj) of the degeneracy tensors and reversal of the spin index {j,mj) of the structural 
tensors. Reversal of the degeneracy index is trivial since the cup and cap transforma- 
tions act as the Identity Id . on it whereas the reversal of the spin index is mediated by 
transformations fi^"'' and fi ■''''. 

Figure 5.19(i)-(ii) introduces a graphical representation of the cup and cap tensors. The 
cup tensor is depicted as a small circle with two incoming lines (forming a 'cup') whereas 
a cap tensor is depicted as a small circle with two outgoing lines (forming a 'cap') (Bacz; 
Biamonte et al., 2010). 

Next, we illustrate how an outgoing index of a tensor can be reversed by means of the 
cup transformation. A cap transformation can be used to reverse an incoming index in 
an analogous way. 

Example 12: Consider a rank-2 SU(2)-invariant tensor T with outgoing indices 
•^ = iJaytj^jnij^) and b = {jf,,tj^,mj^) and which is given in the canonical form, 

{{a, 6}, {'out', 'out'},{P,}}, (5.173) 

where j assumes all values of ja that are equal to a value of jf,. Consider reversing index a of 
T as shown in Fig. 5.20(i). The resulting tensor (or matrix) T' is obtained by multiplying 
tensor T with a cup by contracting a. We follow the convention that multiplying with a 
cup corresponds to bending index a upwards from the left in the graphical representation. 
The same index can be bent upwards from the right by multiplying with the transpose of 
the cup. 

The resulting matrix T' has the canonical form 

{{a, 6}, {'in', 'out'}, {P;}}, (5.174) 

where 

P' = , ^' . (5.175) 

In order to explain this expression consider Fig. 5.20(ii) where the reversal is depicted as 
it is performed on the canonical form of T. Reversal of the spin index equates to replacing 
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the shaded region by a straight hne. This corresponds to applying the following algebraic 
identity 

The factor J^-^ is absorbed into the degeneracy tensor Pj, Eq. (5.175), to obtain the 
final canonical form. I 

Example 13: Consider a rank-3 SU (2) -invariant tensor T which is given in the canonical 
form, 

{{a, 6, c}, {'in', 'out', 'out'}, {4,,, J}. (5.177) 

Consider reversing index h of tensor T as shown in Fig. 5.20(iii) by multiplying T with a 
cup such that h is contracted. The canonical form of T' reads 

{{a, 6, c}, {'in', 'in', 'out'}, i^'^^-^^J, (5.178) 

where 



^Oajbjc ~ ^OjbjajcJajbjc- (5.179) 



The recoupling coefficient -^oi/iajc ^-PPsars due to the reversal of the spin index {jh,mjj, 
as shown in Fig. 5.20(iv). The Clebsch-Gordan tensor and the cup within the shaded 
region are replaced with another Clebsch-Gordan tensor and a recoupling coefficient. 
This is achieved by applying a resolution of Identity on spins ja and jb and simplifying 
the resulting diagram by applying the equality shown in Fig. 5.11(ii). I 

The procedure of reversing the spin index illustrated in Example 13 can be applied to 
reverse a spin index of a generic rank-A; SU(2)-invariant tensor. Recall that a structural 
tensor is maintained as a trivalent tree of Clebsch-Gordan tensors. Reversal of the spin 
index corresponds to multiplying a cup with a Clebsch-Gordan tensor within this tree. 
Then, as in Example 13, we proceed by replacing the Clebsch-Gordan tensor and the cup 
by another Clebsch-Gordan tensor and a recoupling coefficient. The recoupling coefficient 
is absorbed into the degeneracy tensor to obtain the canonical form of the resulting tensor. 
In this way we can reverse an index of a generic rank-A; SU(2)-invariant tensor. 
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Jb Ja 



Figure 5.21 - Permutation of indices [Fig. 5.2(ii)] as performed on the canonical form of 
a rank-3 SU(2)-invariant tensor. The permutation decomposes into permutation of the de- 
generacy indices and permutation of the spin indices. The latter equates to replacing the 
Clebsch-Gordan tensor and a 'cross' with a Clebsch-Gordan tensor and a numerical factor 

Tpswap 

5.6.2 Permutation of indices 

Let us focus on the swap of two adjacent indices of an SU(2)-invariant tensor. As men- 
tioned in Sec. 5.1.2 an arbitrary permutation of indices can be applied as a sequence of a 
number of such swaps. 

Consider the swap e.g. Eq. (5.4) of two adjacent indices of a rank-3 SU (2) -invariant tensor 
T that is given in the canonical form, 

{{a,6,c},{'in', 'in', 'out'},{4,,,J}. 

Then tensor T' that is obtained as result of swapping indices a and b has the canonical 
form 

{{6,a,c},{'in', 'in', 'out'},{i^'^,.^,,}}, 

where 



^ihiaic ~ ^iaJh^ic^iajbjc- (5.180) 



Here i^^^^'p is a rank-3 SU(2)-invariant tensor with components R^'^J ^^^^ 

^ri-.c = {-ir^''-'% (5.181) 

which mediates the swap of the spin indices {ja,mj^) and {jb,jmt) that fuse into index 
ijcjmj, see Fig. 5.21. That is, 

/^ fuse 7~) swap /^ fuse /' tX 1 Q0\ 
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Figure 5.22 - Illustration of the property that reversal of indices "commutes " with a permu- 
tation of them. 



(The same tensor RrT^-i 
tensor CJ^^.^^j^^^^j^^^^.) 



also relates, in a similar way, tensor C?^J^* ,,• ^ . ^ and 



When swapping two adjacent indices of a generic rank-fc tensor the degeneracy tensors 
P and P' are also related directly by the swap tensor R''^'^^, such as in Eq. (5.180), if we 
work in a canonical form in which the indices that are swapped belong to the same node 
of the trivalent tree that characterizes the canonical form. 

Notice how the canonical form of an SU(2)-invariant tensor facilitates a computational 
speedup for permutation of indices: permuting indices of the tensor is reduced to permut- 
ing indices of the much smaller degeneracy tensors. Figure 5.25 illustrates the computa- 
tional speedup corresponding to a permutation of indices performed using our reference 
implementation MATLAB. In this implementation permutation of several indices is per- 
formed without necessarily breaking the permutation into swaps, see Sec. 6.0.4 in Chapter 
6. 

One can also consider manipulations that involve both reversing indices and permuting 
them. In this context it is useful to note that these manipulations "commute" with one 
another, as illustrated in Fig. 5.22. 

5.6.3 Reshape of indices 



The transformation that implements the reshape of indices of an SU(2)-invariant tensor 
depends on the directions of the indices. We analyze three distinct cases. First, we 
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consider fusion of two outgoing indices into an outgoing index and splitting of an outgoing 
index into two outgoing indices. Second, we consider the analogous reshape of incoming 
indices. And third, we consider the fusion of an incoming index with an outgoing index. 

Let us consider the fusion e.g. Eq. (5.5) of two outgoing indices of an SU(2)-invariant 
tensor T. In order to obtain the reshaped tensor T' in a canonical form it is required 
that the fused index be maintained in the spin basis. However, the direct product of 
indices d = a x b may result in an index that does not label a spin basis. Therefore, we 
fuse indices by multiplying T with the fusing tensor T^"^^.^ such that indices a and b are 
contracted [Fig. (5.23(i))], 

'^dc-/, TabcTa"b%d^ (5.183) 

ab 

or in the canonical form [Fig. 5.23(ii)] , 



^jdjc ~ A^ X^ -^jatj^Jbtj^^jdtjj^Jajtjc- (5.184) 



Notice that the fusion of the spin indices, here, is straightforward. We proceed by mul- 
tiplying with tensor C*''""^ and replacing the resulting 'loop' in the figure with a straight 
line [Fig. 5.7(ii)]. The fusion of two adjacent indices of a generic rank-fc SU(2)-invariant 
tensor follows a straightforward generalization of Eq. (5.186). By working in a canonical 
form that is characterized by a trivalent tree in which the two indices belong to the same 
node, the fusion of the spin indices involves a simple loop elimination, similar to the one 
illustrated in Fig. 5.23(ii). 

The original tensor T can be recovered from T' by splitting the index d back into indices 
a and b. This is achieved by multiplying tensor T' with the splitting tensor TJ^\ ^ such 
that d is contracted [Fig. 5.23(iii)], 



fabc^y^f',JjZ,,, (5.185) 

or in the canonical form [Fig. 5.23(iv)], 



/ J -^ dc d—^a,bi 
d 



^jdjc ~ Z_^ Z^ ^jJj^Jitj^jatj/jajbjc- (5.186) 



3a3b tja^jft 
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A ;. ^, ^ A 



Figure 5.23 - (i) Fusion of two outgoing indices of an SU(2)-invariant tensor by means of 
the fusing tensor T'"'^ (ii) Fusion in the canonical form of the tensor decomposes into the 
fusion of the degeneracy indices using tensor X^"^", and the fusion of the spin indices using 
tensor C'"'^ The latter can be performed for free since the loop can directly be replaced with 
a straight line [Fig. 5.7(ii)]. (iii) Splitting of an outgoing index into two indices by means of 
the splitting tensor T''''''*. (iv) Splitting the index in the canonical form of the tensor. 



Notice that the sum in Eq. (5.186) imphes that a reshaped tensor Pj^j^ involves a linear 

Thus, performing the fusion in the canonical form 



combination of several tensors P, 



JaJbJc ' 



requires more work than reshaping regular indices which is a simple rearrangement of the 
tensor components. As a result, fusing indices of SU(2)-invariant tensors can be more 
expensive than fusing indices of regular tensors, as illustrated in Fig. 5.25 for a reshaping 
done in MATLAB. 



118 



Implementation of non-Abelian symmetries I 




Figure 5.24 - (i) Fusion of two incoming indices into an incoming index, and (ii) splitting an 
incoming index into two incoming indices can be performed in one of two way. 



Next, let us consider fusing two incoming indices into a single incoming index. This can 
be done in one of two equivalent ways. The first involves multiplying the tensor with a 
splitting tensor by contracting the two incoming indices. Equivalently, if one prefers to 
use the fusing tensor, one can reverse the two indices, multiply with the fusing tensor, 
and finally reverse the fused index. The two approaches are depicted in Fig. 5.24(i). The 
fused index can be split back into the original indices by reverting the fusion. In the first 
approach this is done by multiplying with a fusing tensor while in the second approach 
this is done by multiplying with a splitting tensor and then reversing the two indices 
[Fig. 5.24(ii)]. 

Finally, consider the fusion of an incoming index with an outgoing index to produce, say, 
an outgoing index. This can be achieved by reversing the incoming index and then fusing 
the indices by means of a fusing tensor. The fused index should be split in a consistent 
manner by reverting this fusion procedure. 
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5.6.4 Multiplication of two matrices 

Let M and A^ be two SU(2)-invariant matrices given in the canonical form 

^ = 0(4- ® 4-+i)> N = 0(iV, ® 4-+i). (5.187) 

3 J 

Then the SU(2)-invariant matrix T = MN obtained by multiplying together matrices M 
and A^ has the canonical form 

^ = 0(^.®4+i), (5.188) 

where Tj is obtained by multiplying matrices M, and Nj, 

f,=M,N,. (5.189) 

Clearly, computational gain is obtained as a result of performing the multiplication T = 
RS block-wise. This is illustrated by the following example. 

Example 13 : (Computational gain from blockwise multiplication) Consider 
vector space V that decomposes as V = djYj where j assumes values 1, ■ ■ ■ ,q and let 
dj = d, Vj. The dimension of the space V is dp where p = X]1^=i(2j + I) = q"^ + q- 

Consider an SU(2)-invariant matrix T : V — t- V. Since there are q blocks Tj and each block 
has size d x d, the SU(2)-invariant matrix T contains qd"^ coefficients. For comparison, a 
regular matrix of the same size contains d'^p'^ coefficients, a number greater by a factor of 
0(g3). 

Let us now consider multiplying two such matrices. We use an algorithm that requires 
0{l^) computational time to multiply two matrices of size / x /. The cost of performing 
q multiplications oi d x d blocks in Eq. 5.189 scales as 0{qd^). In contrast the cost of 
multiplying two regular matrices of the same size scales as 0{d^p^), requiring 0{q^) times 
more computational time. Figure 5.26 shows a comparison of the computation times when 
multiplying two matrices for both SU(2)-invariant and regular matrices. I 
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5.6.5 Factorization of a matrix 

The factorization of an SU(2)-invariant matrix T can also benefit from the block-diagonal 
structure. Consider, for instance, the singular value decomposition (SVD), T = USV, 
where U and V are unitary matrices and 5* is a diagonal matrix with non-negative com- 
ponents. If T has the canonical form 

^ = 0(^.®4+i), (5.190) 

j 

we can obtain the SU(2)-invariant matrices 

-5 = 0(4-® 4+1), 

j 

^ = 0(^.®4-+i), 
j 

by performing SVD of each degeneracy matrix Tj independently, 

f, = U,S,V,. (5.191) 

A different factorization of T, such as spectral decomposition or polar decomposition, 
can be obtained by the analogous factorization of the blocks Tj. The computational 
savings are analogous to those described in Example 13 for the multiplication of matrices. 
Figure 5.26 shows a comparison of computation times required to perform a singular value 
decomposition on SU(2)-invariant and regular matrices using MATLAB. 

5.7 Supplement: Examples of evaluating a spin net- 
work 

Let us consider a spin network S{t,t') that is constructed by means of two fusion trees 
T and t' in the following way. First obtain a tree tensor network T by attaching a tensor 
^tusc |.Q qq^q]^ node the fusion tree r. A tensor (7*^""= mediates the fusion of the incoming 
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spins into the outgoing spin. Next, obtain the splitting tree that is dual to r'. A splitting 
tree is obtained by reversing the direction of all links of a fusion tree. In the graphical 
representation this corresponds to a horizontal reflection of the fusion tree. Then obtain 
a tree tensor network T' by attaching to each node of the splitting tree a tensor C^^'^ 
that mediates the splitting of the incoming spin into outgoing spins. The spin network 
iS(t, t') is obtained by connecting the open links of the two tree tensor networks: T and 

r. 

Since the spin network S{t, t') has two open links it can be contracted to obtain an 
SU(2)-invariant matrix, which according to Schur's lemma is proportional to the Identity. 
An important property of S{t, t') is that this proportionality factor can be evaluated 
algebraically without contracting the spin network. This property can be exploited to 
suppress the potentially high cost of contracting spin networks in numerical simulations. 

The spin network S{t, t') can be evaluated in terms of the values of basic spin networks 
that are shown in Fig. 5.7(ii) and Fig. 5.11(ii). The first step of the evaluation procedure 
generally involves expressing the spin network as a composition of these basic spin net- 
works. This can be achieved by applying, possibly several times, a resolution of Identity, 
Fig. 5.7(i), on appropriate links of the spin network. Then one proceeds by recursively 
applying the equalities in Fig. 5.7(ii) and Fig. 5.11(ii) to regions of the spin network, 
eventually replacing the spin network with a straight line and an overall numerical factor. 
Figure 5.27(i) illustrates these steps for the simple case of evaluating the spin network of 
Fig. 5.13 in terms of two recoupling coefficients. 

We can also consider spin networks that have intercrossing lines such as those which appear 
when applying permuting indices of an SU(2)-invariant tensor. Such a spin network can be 
evaluated in terms of recoupling coefficients and swap factors, as illustrated in Fig. 5.27(ii). 
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Figure 5.25 - Computation times (in seconds) required to permute indices of a rank-four 
tensor T, as a function of the size of the indices. All four indices of T have the same size 9d, and 
therefore the tensor contains \T\ = D^d^ coefficients. The figures compare the time required 
to perform these operations using a regular tensor and an SU(2)-invariant tensor, where in the 
second case each index contains three different values of spin j = 0, 1, 2, each with degeneracy 
d, and the canonical form of Eq. (5.161) is used. The upper figure shows the time required 
to permute two indices: For large d, exploiting the symmetry of an SU(2)-invariant tensor by 
using the canonical form results in shorter computation times. The lower figure shows the time 
required to fuse two adjacent indices. In this case, maintaining the canonical form requires 
more computation time. Notice that in both figures the asymptotic cost scales as 0{d'^), or 
the size of T, since this is the number of coefficients which need to be rearranged. We note 
that the fixed-cost overheads associated with symmetric manipulations could potentially vary 
substantially with choice of programming language, compiler, and machine architecture. The 
results given here show the performance of our MATLAB implementation of SU(2) symmetry. 
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Figure 5.26 - Computation times (in seconds) required to multiply two matrices (upper panel) 
and to perform a singular value decomposition (lower panel), as a function of the size of the 
indices. Matrices of size Qd x M are considered. The figures compare the time required 
to perform these operations using regular matrices and SU(2)-invariant matrices, where for 
the SU(2) matrices each index contains three different values of the spin j = 0,1,2, each 
with degeneracy d, and the canonical form of Eq. (5.137) is used. That is, each matrix 
decomposes into three blocks of size d x d. For large d, exploiting the block diagonal form 
of SU(2)-invariant matrices results in shorter computation time for both multiplication and 
singular value decomposition. The asymptotic cost scales with d as 0{d'^), while the size of 
the matrices grows as 0{d^). {for matrix multiplication, a tighter bound of 0{d'^'^) for the 
scaling of computational cost with d is seen in this example.) We note that the fixed-cost 
overheads associated with symmetric manipulations could potentially vary substantially with 
choice of programming language, compiler, and machine architecture. The results given here 
show the performance of our MATLAB implementation of SU(2) symmetry. 
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Figure 5.27 - Illustration of evaluating a spin network. 



Chapter 6 



Implementation of non-Abelian symmetries 
II 



In this chapter we will describe a specific scheme for implementing non-Abelian symme- 
tries. Our implementation is based on a special canonical form, the tree decomposition, 
of symmetric tensors. 

A tree decomposition of a symmetric tensor corresponds to representing and storing the 
tensor as a tree tensor network made of two parts: (i) a symmetric vector and (ii) possibly 
several splitting tensors T^""'". We describe how to implement the tensor manipulations 
within the set V of primitive operations based on tree decompositions. In a tree decom- 
position, reshape and permutation of indices take a very simple form. In order to obtain 
the vector of the output tensor, one needs to simply multiply the vector of the initial tree 
decomposition with a matrix T [Fig 5.13(ii)] that depends only on the permutation or 
reshape. 

This approach offers several advantages. Reshapes and permutations can be performed 
without breaking them into pairwise fusions and swaps, as was described in the previous 
chapter. More importantly, one can precompute (that is, compute before running the 
algorithm) the matrices T since these do not depend on the actual components of the 
tensor being manipulated. This is of special advantage in the case of iterative algorithms, 
where by pre-computing these matrices one also eliminates the cost of evaluating spin 
networks at runtime, thus substantially reducing the computational costs. 

125 
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6.0.1 Tree decompositions of SU(2)-invariant tensors 

Consider a rank-/;; SU(2)-invariant tensor T with indices {ii,i2, ■ ■ ■ ,ik} and directions 
D. Let us apply the following transformations on tensor T to obtain a vector. First 
reverse all incoming indices of T to obtain another tensor T'. Then fuse the indices of T' 
according to a given fusion tree r to obtain an SU(2)-invariant vector v. This gives rise 
to a decomposition of tensor T in terms of the vector v, a set of splitting tensors that 
revert the fusion sequence r, and a set of cup tensors that reverse the split indices that 
are identified with the incoming indices of T. We refer to such a decomposition as a tree 
decomposition of T and denote it as V{T). It is completely specified by the following list 
of elements: 

V{f) = {{li,l2,...,lk},D,T,v). (6.1) 

Here the fusion tree r determines the splitting tensors that are part of the decomposition 

— * 

while the directions D indicate the presence or absence of a cup tensor on the open indices 
of the tree decomposition. 

A tree decomposition of a rank-6 SU(2)-invariant tensor is shown in Fig. 6.1. The tree 
decomposition in the diagram can be specified as, 

V{T) = ({ii, Z2, ^3, ^4, ^5,^6}) {'in', 'out', 'out', 'iu-R', 'out', 'out'}, r,'0), (6.2) 

where 

T : {i4,i5 ^ ie] i2,i3^ic; i^ie ^ ic] ii,id ^ ib;ib,ic ^ ia}- 

In the graphical representation of a tree decomposition V(T) the vector v appears at the 
top of the tree, the 'body' of the tree comprises of splitting tensors that are connected 
according to the fusion tree r and the indices {ii,i2, • • • ,"^6} are associated, from left to 
right, to the open lines at the bottom of the tree. Some open indices are bent upwards 
by attaching cup tensors. A value D{1) = 'in' indicates a cup tensor is attached to index 
ii while D{1) = 'out' indicates its absence. We additionally denote by D{1) = 'in-R' that 
the transpose of a cup tensor is attached to index i;. In the graphical representation, the 
values D{1) = 'in' or D{1) = 'in-R' correspond to bending the index ii upwards from the 
left or from the right respectively. 
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I, i^ i^ I 




Figure 6.1 - A tree decomposition 2?(T) of a rank-6 SU(2)-invariant tensor T with indices 
{ii, ^2, . . • , ie}- (All internal indices are summed over.) The tree decomposition consists of an 
SU(2)-invariant vector v, a set of splitting tensors and cup tensors that are attached to the 
incoming indices of T. The tree decomposition is obtained by applying a resolution of Identity 
X(r) on the tensor. The fusing and splitting tensors that constitute T{t) are connected 
together according to the fusion tree r. 

The vector v is obtained by applying an resolution of Identity, denoted X(t), on tensor 
T', as shown on the r.h.s. of Fig. 6.1. The resolution of Identity X(t) is given by a tensor 
network made of a set of fusing tensors, that fuse the indices of T' according to the fusion 
tree r, and the corresponding set of splitting tensors that inverts the fusion. The vector 
V is obtained by contracting T' with the fusing tensors. 



We emphasize that the cup tensors are stored as part of the tree decomposition without 
consuming them into the tree. This is done to simplify reshape and permutation of indices 
of a tree decomposition since these operations can be performed without noticing the cup 
tensors. For instance, in order to permute the open indices of a tree decomposition one 
may proceed by detaching any cup tensors from the tree, permuting the indices and re- 
attaching the cup tensors to the updated tree, a direct application of the commutation 
property depicted in Fig. 5.22. On the other hand, manipulations that involve summing 
over an index that is attached to a cup tensor are an exception. For example, when 
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(i) 





(ii) 



\f \f \f \f 





Figure 6.2 - (i) Two different, but equivalent, tree decompositions 'D^(T) and V^ {T) of a 
rank-4 SU(2)-invariant tensor T . The two decompositions are characterized by different fusion 
trees r^ and r^. (ii) Tree decompositions 'D^(T) and V^ {T) are obtained by applying the 
resolutions of Identity X(t^) and T{t^) on T. 

multiplying two SU(2)-invariant matrices, each given as a tree decomposition, the cup 
tensor has to be properly considered to obtain the resultant matrix. This is discussed in 
Sec. 6.0.6. 

6.0.2 Mapping between tree decompositions 



The same tensor T may be expressed in different tree decompositions corresponding to 
different choices of the fusion tree. Two different fusion trees r"^ and r^ lead to two 
different tree decompositions V^{T) and 'D^(T) of the same tensor T. As an example we 
show two different but equivalent tree decompositions of a rank-4 tensor in Fig. 6.2(i). 
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The two decompositions 



{{ii,i2,i3,H},D,T^,v^) and {{ii,i2,i3,H}, D,t^ ,v^), 



are obtained by applying on the tensor the resolutions of Identity X(r^) and X(t^) 
respectively that are separately depicted in Fig. 6.2(ii). 

Suppose now that we have a tensor T in a tree decomposition V^{T) and we wish to 
transform it into another tree decomposition ©^(T). We find it convenient to obtain 
the vector -0^ G P^(T) in steps, as shown in Fig. 6.3. First detach all cup tensors 
from V^{T) and apply the resolution of Identity X(t^) on the open indices of the tree. 
Then contract the splitting tensors in V^{T) and the fusing tensors in P^(T) to obtain a 
matrix T{t^ , '''^)- The new vector -0^ can be obtained by multiplying v^ with the matrix 

f(T^,T^), 



{;^=r(r^,Tn{)^. (6.3) 



Thus, the matrix T{t^ , r^) can be used to map from one tree decomposition of an SU(2)- 
invariant tensor into another tree decomposition of the same tensor. Recall that the 
components of r(T^,T^) can be expressed in terms of recoupling coefficients [Fig. 5.14, 
Eq. (5.120)]. 

To summarize the above procedure we define a template routine NEWTREE that takes as 
input a tree decomposition V^{T) and a fusion tree r^ and returns the tree decomposition 
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Figure 6.3 - Mapping a tree decomposition V^ (T) of an SU(2)-invariant tensor T to another 
tree decomposition V^ (T) by applying a resolution of Identity X(t^) to V^{T). We obtain 



an intermediate matrix f (r 



X ^Y^ 



by contracting together the splitting tensors in V^ (f) and 



the fusing tensors in X(t^) and then multiply it with vector v^ to obtain vector v^ . 



V (T) of the tensor. The routine reads 



NEWTREE 
Input: 

Output: 



({ii,i2,---,4},£',r ,{) ) 



({il,Z2,---,4},^,T ,v ) 



Compute f (r 



X ^Y. 



\Y 



X _y\-x 



r(T^,r^){) 



return(I?^(f)). 



(6.4) 
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(where := denotes 'stored as'.) 

Recall that the matrix T is sparse [Eq. (5.115)]. It can be shown that the matrix- vector 
multiplication, Eq. (6.3), can be performed with a cost that is 0(1-01) by means of sparse 
multiplication. 

Next we describe how manipulations in the set V of primitive tensor manipulations 
[Sec. 5.1.5] are performed on tree decompositions. Consider an SU(2)-invariant tensor 
T that has been given as a tree decomposition T>{T), 



T^iT) = i{ii,i2,---,ik},D,T,v). 



Let T' denote the SU(2)-invariant tensor that is obtained from tensor T as a result of a 
manipulation in V. Also, let V{T') denote a tree decomposition of T', 



I)(t') = (K,z'2,...,C},^',T',t)'). 



We will describe how the components of vector v' are determined systematically in terms 
of components of the vector v. 



6.0.3 Reversal of indices 

Reversal of an index of a tree decomposition is trivial since the cup tensors are stored as 
part of the tree decomposition. It corresponds to attaching a cup (or its transpose) to 
the corresponding open index of the tree in case the index is outgoing or detaching the 
cup from the index in case it is incoming. This simple procedure is summarized in the 
following template routine which describes reversal of possibly several indices of tensor 
T according to new directions D' provided as input. No computation is involved in the 
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r(r,p,-r') 



V{T') 




a c b d 



a c b d 



a c b d 



a c b d 



Figure 6.4 - Permuting indices of a rank-4 SU(2)-invariant tensor T given in a tree decompo- 
sition. The "crossings" in the diagram can be absorbed into the tree by applying a resolution 
of Identity X(t') (for a given fusion tree t'). An intermediate matrix T{t, p, r') is obtained by 
contracting together the splitting tensors in V{T), the permutation p and the fusing tensors 
in X(t'). The matrix is multiplied with the vector v to determine the updated vector v' . 



procedure. Only information pertaining to the directions of indices is updated, 



REVERSE 
Input: 

V{f) :-- 
D' 
Output: 

V{f') : 



{{ii,i2,...,ik},D,T,v) 



{{ii,i2,...,ik},D',T,v) 



V{f') := {{ii,i2,...,ik},D',T,v) 



return(r'(f')) 



(6.5) 
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6.0.4 Permutation of indices 

The procedure to permute indices of a tree decomposition is illustrated in Fig. 6.4(i). We 
consider a rank-4 SU(2)-invariant tensor with indices {a, b, c, d} and apply a permutation 

P, 



{a, c, b, d} = p({a, b, c, d}). 



The permutation is depicted by intercrossing index a and index c of the tree. This crossing 
can be 'absorbed' into the tree by applying the resolution of Identity X(t') on the tree. In 
order to determine the vector v' we contract the splitting tensors in P(T) and the fusing 
tensors in X(t') to obtain a matrix r(T,p,T'), which is then multiplied with the initial 
vector V, 



V 



' = r(r,p,T>. (6.6) 



Clearly, the above procedure can be employed to apply any permutation p on the indices of 
a rank-A; SU(2)-invariant tensor. Matrix r(r, p, r') is a generalization of matrix T{t, t') 
[e.g. Fig. 5.14] in that it additionally includes a permutation of indices. The latter can 
then be seen as a special instance of r(T, p, r') with a trivial permutation of indices. The 
components of the degeneracy part D of matrix r(T, p, r') are given by Eq. (5.120) where 
coefficients S'^-^^ ^^"^ ^^ "'' can be expressed in terms of recoupling coefficients and swap 
factors (see Sec. 5.7). 

Finally, note that the cup tensors do not play any role in the permutation since reversal 
of indices commutes with a permutation of them [Fig. 5.22]. In practice, all cup tensors 
can be detached from the tree before applying the permutation and then re-attached to 
the updated tree. 

The procedure to permute indices of a tree decomposition is summarized in the following 
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template routine: 



PERMUTE 
Input: 

f := {{ii,i2,...,ik},D,T,v) 



t' 



P 
Output: 

V{f') := {{i[, i'2, . . . , 4}, D', r , v) 

Compute r(r, p, r') 
v' = r(r,p, t')v 

{h,h,---,i'k} = pi{ii,i2,---,ik}) 

f':={{t[,t'„...,t',},D',T',v') 

return(r'(t')) (6.7) 

6.0.5 Reshape of indices 

Consider fusing a pair of adjacent indices ii and ii+i of the tree decomposition V{T). Let 
us suppose that indices ii and i/+i do not carry cup tensors and also that they belong 
to the same node in V{T). Indices ii and 2/+i can be fused into an index i by applying 
the tensor T/"f _^j and using the equality shown in Fig. 5.9(i) to immediately obtain the 
tree decomposition P(T'). This is illustrated in Fig. 6.5(i). Note that the final vector v' 
is the same as the initial vector v. The updated fusion tree r' can be obtained from r by 
deleting the node {ii, ii+i — > i} from r. We denote this as, 

t' = T - {iuk+i -^ im}- 

The original tree decomposition may be recovered from T>{T') by splitting index i back 
into indices ii and ii+i. This operation is again straightforward since it does not involve 
a computation of vector components, as illustrated in Fig.6.5(ii). The original fusion tree 
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r is recovered by concatenating a node to r', 

r = T'U{i^ii,ii+i}. (6.8) 

Now let us consider fusing indices ii and i;+i that do not belong to the same node of V(T). 
In this case one can first map P(T) into another tree decomposition P(T) in which indices 
ii and z/+i belong to the same node and then proceed with the fusion on the tree P(T) 
as described above. This can be done by applying the procedure NEWTREE (6.4) with 
inputs T>{T) and the desired fusion tree. 

Consider the template routine FUSE that fuses indices according to a set of disjoint 
fusion trees ti,T2, . . . where each fusion tree specifies fusion of a subset of adjacent indices 

FUSE 

Input args: 

'^(T) := ({ii, i2, • • • , ik}, D, r, v) 
{Ti,r2,...} 

Final indices: {i'l, ^2, • • • , i'l} 
Fusion tree of final tensor: r' 
Output args: 

V{f') := {{i[, 4, . . . , i'l}, 3, r', v) 



r" = r' U Ti U T2 U . . . 

V"{f) = NEWTREE(r'(f),r") 



v' = v" 



V{f') := {{i[,i'2,...,i'i},T',v) 

return(r'(r')) (6.9) 

Notice that here we essentially apply the total fusion at once by concatenating the input 
fusion trees ti,T2,... into a single tree and then applying the procedure NEWTREE. 
Consequently, the fusion is carried out by means of a single matrix- vector multiplication. 
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Furthermore, the computational cost incurred by the procedure is dominated by the cost 
of this step. As mentioned previously, this cost is O(|-0|). 

Also consider the following routine to split indices {i[,i2,...} of a tree decomposition 
V(T') (typically the output of FUSE) by reversing the fusion sequence encoded in fusion 
trees ri, r2, . . .: 

SPLIT 

Input args: 

Vif'):={{t[,t'„...,t[},D,T',v') 
Final indices: {ii, ^2, • • • , h} 

Ti,T2,... 

Output args: 

^(^) ■= {{ii,i2,---,ik},D,T,v) 

r = r' U Ti U T2 U . . . 

V = v' 

f := {{ii,i2,...,ik},r,v) 

return(f) (6.10) 

Note that no computation of vector components is involved in this procedure. 

Let us now describe how to reshape indices that may carry cup tensors. First consider 
the fusion of indices each of which carries a cup tensor. We proceed by detaching the 
cup tensors from the indices, applying the procedure FUSE and finally attaching a cup 
tensor to each of the fused indices. Analogously, an index that carries a cup tensor may 
be split into two indices, by detaching the cup tensor, applying the procedure SPLIT and 
attaching a cup tensor to each of two indices so obtained. 

Finally, consider the fusion of an index that carries a cup tensor with an index that does 
not carry a cup tensor. The fusion proceeds by detaching the cup tensor and then applying 
the procedure FUSE on the indices. The fusion is to be reversed in a consistent manner 
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(i) 





^ (ii) , 





Figure 6.5 - (i) Fusion of two adjacent indices that belong to the same node of the tree 
decomposition proceeds by simply deleting the node to obtain the updated tree decomposition, 
(ii) Splitting an index corresponds to concatenating a new node to the tree decomposition. 



by first applying the procedure SPLIT on the fused index and then attaching a cup tensor 
to the originally incoming index. 



6.0.6 Matrix multiplication and factorizations 



Let us consider how matrix operations are performed on tree decompositions. Two SU(2)- 
invariant matrices, each given as a tree decomposition, may be multiplied together by 
first obtaining the matrices in a block-diagonal form (from the respective tree decompo- 
sitions), performing a block-wise multiplication (Sec. 5.6.4) and recasting the resulting 
block-diagonal matrix into a tree decomposition. 

An SU(2)-invariant matrix may be factorized e.g. singular value decomposed in a similar 
way. One proceeds by obtaining the matrix in a block-diagonal form, performing block- 
wise factorization (Sec. 5.6.5), and recasting each of the factor block- diagonal matrices 
into a tree decomposition. 

In the remainder of the section we explain how a block-diagonal form is obtained from a 
tree decomposition and vice-versa. 



138 



Implementation of non-Abelian symmetries II 






,M 



2j + l 




Figure 6.6 - The block-diagonal form of an SU(2)-invariant matrix is obtained from its tree 
decomposition by performing two multiplications. At each step the tensors within the shaded 
region are multiplied together. The same steps are also shown in the canonical form. 



Block-diagonal matrix from the tree decomposition 

Consider a tree decomposition I?(T) of an SU(2)-invariant matrix T. The decomposition 
T>{T) comprises of a vector v, a splitting tensor T'''''" and a cup tensor Cl"'^''. We wish to 
obtain, from T>{T), the corresponding block diagonal matrix, 



f = 0(f;®4+i). 



(6.11) 



This can be achieved by multiplying together the vector, the splitting tensor and the cup 
tensor. We perform this multiplication in two simple steps as shown in Fig. 6.6. We first 
multiply V with T'^"* to obtain an intermediate SU(2)-invariant tensor T' that takes the 
canonical form, 

^i=0(^;®%)' (6-12) 



where the components {T'^t't" of Tj are given by 



(6.13) 



We then multiply (algebraically) tensor T' with the cup tensor to obtain the block-diagonal 
matrix T to obtain 

T, = ^r;. (6.14) 
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(5) g 



Figure 6.7 - The five steps of tensor multiplication [Fig. 5.4] as adapted to the presence 
of the symmetry. For simplicity, the tree decompositions are not explicitly shown; the circle 
representing a tensor masks the tree decomposition of the tensor. 

TVee decomposition from the block-diagonal matrix 



The tree decomposition P(T) can be obtained from the block-diagonal form (6.11) in a 
straightforward manner by reverting the previous procedure. We first multiply T with 
a cap tensor to obtain tensor T'. Once again, the outcome of this multiplication follows 
algebraically. We obtain 



{f'X,,„ = {2j + l){f,)t't". 



(6.15) 



We then fuse the indices of T' to obtain a vector v, 



Vt 



l]l](^i)*'*"^j*?>- 



>-0f 



(6.16) 



j ft" 



The tree decomposition P(T) comprises of vector -0, the splitting tensor X"''"' that reverts 
the fusion in Eq. (6.16) and a cup tensor. 
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Figure 6.8 - The number of spin networks to be evaluated when permuting or reshaping an 
SU(2)-invariant tensor, as a function of the number of indices of the tensor and the number 
of different spins j assigned to each index of the tensor. The plot shows the increase in the 
number of spin networks that are evaluated when reshaping tensors with increasing number of 
indices. It also illustrates the corresponding increase that results from increasing the number of 
different values of spin j that are assigned to the indices of the tensor. (Note that the number 
of spin networks does not depend on the degeneracy dimension of a spin j.) Consequently, the 
cost of reshaping tensors with a large number of indices may potentially become significant. 



6.0.7 Multiplication of two tensors 



We can now consider the multiplication of two SU(2)-invariant tensors by breaking it into 
a sequence of five elementary steps consisting of reversals, permutes, reshapes and matrix 
multiplication, as was exemplified in Sec. 5.1.3 and Fig. 5.4. Here the elementary steps 
are performed on the tree decompositions of tensors. Figure 6.7 illustrates the five steps 
of the tensor multiplication, Eq. (5.8), as adapted to tree decompositions. For simplicity, 
we have not shown the tree decompositions in the figure and the circle that depicts a 
tensor can be imagined to mask the tree decomposition of the tensor. 
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6.0.8 Discussion on computational performance 



The core of obtaining computational gain from exploiting the symmetry lies in block- wise 
matrix operations [Fig. 5.26] while permutation and reshape of indices are applied mainly 
to obtain block-diagonal matrices from tensors. As has been illustrated in Fig. 5.25 the 
cost of reshaping, for instance, SU(2)-invariant tensors can be significantly larger than that 
incurred in reshaping regular tensors, and in some case can lead to a severe degradation of 
the overall gain obtained by exploiting the symmetry. Let us analyze the cost associated 
to reshape and permutation of indices of an SU(2)-invariant tensor. 

We have described that by working on tree decompositions reshape and permutation of 
indices equates to multiplying a matrix F with a vector. The computation of F may 
be costly since it generally involve evaluating many spin networks, see Fig. 6.8. Conse- 
quently, the cost of reshaping or permuting tensors with a large number of indices may 
become significant. This is more so the case for iterative algorithms where a fixed set of 
manipulations repeat many times. For example, one may optimize tensors iteratively in 
a variational algorithm such that the components of the tensor are updated in the cur- 
rent iteration and used as an input to the subsequent iteration. Note that each iteration 
involves evaluating a large number of spin networks, albeit the same spin networks are 
evaluated in each iteration. This fact can be exploited to pre-compute the transformations 
F once, say in the first iteration of the algorithm, and storing them in memory for reuse in 
subsequent iterations. By precomputation of these matrices the cost of evaluating many 
spin networks is suppressed from the runtime costs. 

In our MATLAB implementation the use of such a precomputation scheme resulted in a 
significant speed-up of simulations at the cost of storing additional amounts of precom- 
puted data. In the passing we also remark that since all computations have been reduced 
to matrix operations, computational performance can also be potentially enhanced by 
parallelizing and vectorizing the underlying matrix operations. 
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Figure 6.9 - A tensor network J\f made of SU(2)-invariant tensors represents an SU(2)- 
invariant tensor T. This is seen by means of two equalities. The first equality is obtained by 
inserting resolutions of the Identity / = W,Wr on each index connecting two tensors in J\f . 
The second equality follows from the fact that each tensor in TV is SU(2)-invariant. 

6.1 Tensor networks with SU(2) symmetry: A prac- 
tical demonstration 

Consider a lattice C made of L sites where each site / is described by a vector space V*-'-* 
that transforms as a finite dimensional representation of SU(2). The vector space V*-^^ of 
the lattice is given as 

y(C)^^y(l)^ (6.17) 



Consider a state \^) E V'-^-* that is invariant, Eq. 5.60, under the action of SU(2) on the 
vector space V'-^^ We describe |\1') by means of a tensor network made of SU(2)-invariant 
tensors. 

It readily follows that the tensor obtained by contracting such a tensor network is SU(2)- 
invariant, as illustrated in Fig. 6.9. 

On the one hand, by storing each constituent tensor of the tensor network in a canonical 
form we can ensure a compact tensor network description of |\E'). On the other, compu- 
tational speedup can be obtained by exploiting the sparse canonical form of the tensors 
when performing manipulations of individual tensors in a tensor network algorithm. 

In the remainder of the section we illustrate the implementation of SU(2) symmetry in 
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Figure 6.10 - MERA for a system of L = 2x3^ = 18 sites, made of two layers of disentanglers 
u and isometries w, and a top tensor i. 



tensor network algorithms with practical examples. We do so in the context of the Multi- 
scale Entanglement Renormalization Ansatz, or MERA, and present numerical results 
from our reference implementation of SU(2) symmetry in MATLAB. 



6.1.1 Multi-scale entanglement renormalization ansatz 

Figure 6.10 shows a MERA that represent states |^) G V-^^ of a lattice C made of L = 18 
sites. Recall that the MERA is made of layers of isometric tensors, known as disentanglers 
u and isometries w, that implement a coarse-graining transformation. In this particular 
scheme, isometries map three sites into one and the coarse-graining transformation reduces 
the L = 18 sites of C into two sites using two layers of tensors. A collection of states on 
these two sites is then encoded in a top tensor t, whose upper index a = 1, 2, ■ ■ ■ , Xtop is 
used to label Xtop states \^a) G V*^^\ This particular arrangement of tensors corresponds 
to the 3:1 MERA described in (Evcnbly and Vidal, 2009a). We will consider a MERA 
analogous to that of Fig. 6.10 but with Q layers of disentanglers and isometries, which we 
will use to describe states on a lattice C made of 2 x 3*^ sites. 



We will use the MERA as a variational ansatz for ground states and excited states of 
quantum spin models described by a local Hamiltonian H . In order to find an approxi- 
mation to the ground state of if, we set Xtop = 1 and optimize the tensors in the MERA 
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so as to ininimize the expectation value 

(^|i^|^) (6.18) 

where |\1/) G Y^^' is the pure state represented by the MERA. In order to find an approx- 
imation to the Xtop > 1 eigenstates of H with lowest energies, we optimize the tensors in 
the MERA so as to minimize the expectation value 

Xtop 

J2{-^a\ma), {^a\^a')=Saa'- (6.19) 

a=l 

The optimization is carried out using the MERA algorithm described in (Evenbly and 
Vidal, 2009a), which requires contracting tensor networks (by sequentially multiplying 
pairs of tensors) and performing singular value decompositions. 

6.1.2 MERA with SU(2) symmetry 

An SU(2)-invariant version of the MERA, or SU(2) MERA for short, is obtained by 
simply considering SU(2)-invariant versions of all of the isometric tensors, namely the 
disentanglers u, isometries w, and the top tensor t. This requires assigning a spin operator 
to each index of the MERA. We can characterize the spin operator by two vectors, j and 
d: a list of the different values the spin takes and the degeneracy associated with each 
such spin, respectively. For instance, an index characterized by j = {0, 1} and d = {2, 1} 
is associated to a vector space V that decomposes as V = doYo © diYi with do = 2 and 
di = 1. 

Let us explain how a spin operator is assigned to each link of the MERA. Each open 
index of the first layer of disentanglers corresponds to one site of C. The spin operator 
on any such index is therefore given by the quantum spin model under consideration. For 
example, a lattice with a spin-^ associated to each site corresponds to assigning spin-^ 
operators [Eq. (5.24)] to each of the open indices. 

For the open index of the tensor t at the very top the MERA, the assignment of spins 
will depend on spin sector J that one is interested in. For instance, in order to find an 
approximation to the ground state and first seven excited states of the quantum spin 
model within the spin sector J, we choose j = {J} and d = {8}. 



6.1 Tensor networks with SU(2) symmetry: A practical demonstration 145 

For each of the remaining indices of the MERA, the assignment of the pair {j,d) needs 
careful consideration and a final choice may only be possible after numerically testing 
several options and selecting the one which produces the lowest expectation value of the 
energy. 

For demonstrative purposes, we will use the SU(2) MERA as a variational ansatz to obtain 
the ground state and excited states of the spin-^ antiferromagnetic quantum Heisenberg 
chain that is given by, 

L 

i^ = ^/i(^.^+i), (6.20) 

where 

h(s,s+i) ^ 4 (^jW j(^+i) + J(^) j(^+i) + Ji'\ji'^'^) , (6.21) 

Jx, Jy and Jz are the spin-^ operators [Eq. (5.24)]. The model has a global SU(2) sym- 
metry, since the Hamiltonian commutes with the spin operators acting on the lattice C. 
This follows from the fact that each local term /i(*'*+i) in the Hamiltonian commutes with 
the two site spin operators, 

[/,(^-^+i),jW + j^^+i)] = 0, a = x,y,x. (6.22) 

Each spin-^ degree of freedom of the Heisenberg chain is described by a vector space 
V = Vi that is spanned by two orthonormal states [Eq. (5.23)], 

For computational convenience, we will consider a lattice C where each site contains two 
spins. Therefore each site of C is described by a space V = Vq © Vi, where do = I and 
di = 1, also discussed in Example 6. This corresponds to the assignment j = {0, 1} and 
(i = {1, 1} at the open legs at the bottom of the MERA. Thus, a lattice £ made of L sites 
corresponds to a chain of 2L spins. 

Table 6.1 lists some of the spin and degeneracy dimensions assignment (for the internal 
links of the MERA) that we have used in the numerical computations for L = 54 (or 108 
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Figure 6.11 - Error in ground state energy /S.E as a function of x for the Heisenberg model 
with 2L = 108 spins and periodic boundary conditions, in the singlet sector, J = 0. The error 
is calculated with respect to the exact solutions, and is seen to decay polynomially with x fo"" 
the particular choice of spins listed in Table 6.1. 

spins). For a given value of j and d the corresponding dimension x can be obtained as, 



X 



5^(2j + 1) X rf, 



(6.23) 



3^3 



Figure 6.11 shows the error in the ground state energy of the Heisenberg chain as a function 
of the bond dimension x, for the assignments of j and d that are hsted in Table 6.1. For 
the choice of spin assignments listed in the table the error is seen to decay polynomially 
with X, indicating increasingly accurate approximations to the ground state. 



6.1.3 Advantages of exploiting the symmetry 



We now discuss some of the advantages of using the SU(2) MERA. 
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Total bond dimension, x 


Spins j 


Degeneracies d 


4 


{0,1} 


{1,1} 


8 


{0,1} 


{2,2} 


17 


{0,1,2} 


{3,3,1} 


21 


{0,1,2} 


{4,4,1} 


30 


{0,1,2} 


{5,5,2} 


39 


{0,1,2} 


{6,6,3} 


43 


{0,1,2} 


{7,7,3} 


52 


{0,1,2} 


{8,8,4} 


75 


{0,1,2,3} 


{9,9,5,2} 



Table 6.1 - Example of spin assignment in an SU(2) MERA for the anti-ferromagnetic spin 
chain with L = 54 sites (or 108 spins). 



Selection of spin sector 

An important advantage of the SU(2) MERA is that it exactly preserves the SU(2) sym- 
metry. In other words, the states resulting from a numerical optimization are exact 
eigenvectors of the total spin operator J^ : Y^^^ — t- Y^^\ In addition, the total spin J can 
be pre-selected at the onset of optimization by specifying it in the open index of the top 
tensor t. 



Figure 6.12 shows the low energy spectrum of the Heisenberg model H for a periodic 
system of L = 54 sites (or 108 spins), including the ground state and several excited 
states in the spin sectors J = 0, 1, 2. The states have been organized according to spin 
projection mj. We see that states with different spin projections mj (for a given J) are 
obtained to be exactly degenerate, as implied by the symmetry. 

Similar computations can be performed with the regular MERA. However, the regular 
MERA cannot guarantee that the states obtained in this way are exact eigenvectors of 
J^. Instead the resulting states are likely to have total spin fluctuations. This is shown 
in inset of Fig. 6.12, which corresponds to the zoom in of the region in the plot that is 
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Figure 6.12 - Low energy spectrum of H with L = 54 sites (=108 spins). Depicted states 
have spin J of zero (x, blue loops), one (-I-, red loops), or two (o, green loop). The superscript 
^ close to the boundary of a loop indicates that the loop encloses two-fold degenerate states 
e.g., the second, third and fourth spin-1 triplets are twofold degenerate. The inset shows 
a zoom in of the region enclosed within the box. It compares the energies of the two-fold 
degenerate spin-one states within the box with those obtained using the regular MERA (black 
asterix points). Since the symmetry is not protected, the states obtained with the regular 
MERA corresponding to different nij do not have the same energies. 



enclosed within the box. The inset shows (black asterix points) the corresponding energies 
obtained for the enclosed two-fold degenerate J = 1 states using the regular MERA. We 
see that the states corresponding to different values of mj are obtained with different 
energies. 



Also note that by using the SU(2) MERA, the three sectors J = 0, 1 and 2 can be 
addressed with independent computations. This implies, for instance, that finding the 
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Figure 6.13 - Memory cost (in number of components) for storing the MERA as a function of 
the bond dimension %. The horizontal line on this graph shows that this reduction in memory 
cost equates to the ability to store MERAs with a higher bond dimension x'- For the same 
amount of memory required to store a MERA with bond dimension x = 15, one may choose 
instead to store a U(l)-symmetric MERA with x = 26 or an SU(2)-symmetric MERA with 
X = 39. 

gap between the first singlet (J = 0) and the first J = 2 state, can be addressed with two 
independent computations by respectively setting (J = 0, Xtop = 1) and (J = 2, Xtop = 1) 
on the open index of the top tensor t. However, in order to capture the first J = 2 
state using the regular MERA, we would need to consider at least Xtop = 20 (at a larger 
computational cost and possibly lower accuracy), since this state has only the 20**^ lowest 
energy overall. 

Reduction in memory and computational costs 



The use of SU(2)-invariant tensors in the MERA also results in a reduction of computa- 
tional costs. We compared the memory and computational costs associated with using 
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Figure 6.14 - Computation time (in seconds) for one iteration of the MERA energy minimiza- 
tion algorithm, as a function of the bond dimension x- For sufficiently large x. exploiting the 
SU(2) symmetry leads to reductions in computation time. The horizontal line on this graph 
shows that this reduction in computation time equates to the ability to evaluate MERAs with 
a higher bond dimension x'- For the same cost per iteration incurred when optimizing a reg- 
ular MERA in MATLAB with bond dimension x = 18, one may choose instead to optimize a 
U(l)-symmetric MERA with x = 26 or an SU(2)-symmetric MERA x = 33. 



the regular MERA and the SU(2) MERA. We also found it instructive to compare the 
analogous costs associated with a MERA that is made of tensors that remain invariant 
under only a subgroup U(l) of the symmetry group. This entails introducing the spin 
projection operators Jz on the links of the MERA and imposing the invariance of con- 
stituent tensors under the action of these operators. For such a U(1)-MERA, imposing 
such constraints corresponds to conservation of the total spin projection rrij, while the 
total spin may fluctuate. (The explicit construction of the U(1)-MERA was discussed in 
Chapter 4). 
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Figure 6.13 shows a comparison of the total number of complex coefficients that are 
required to be stored for L = 54 sites (corresponding to 108 spins) in the three cases: 
regular MERA, U(l) MERA and the SU(2) MERA. U(l)-invariant tensors (see Chapter 
4) have a block structure in the eigenbasis of J^ operators on each index of the tensor, 
and therefore they incur a smaller memory cost in comparison to regular tensors. For 
example, it can be seen that for the same memory required to store a regular MERA 
with X = 15, one can instead consider storing a U(1)-MERA with x = 21. On the 
other hand, SU (2) -invariant tensors are substantially more sparse. When written in the 
canonical form, SU(2)-invariant tensors are not only block-sparse but each block, in turn, 
decomposes into a degeneracy part and a structural part such that the structural part 
need not be stored in memory. With the same amount of memory that is required to store, 
for example, a x = 15 regular MERA, one can already store a x = 39 SU(2) MERA. 

In Fig. 6.14 we show an analogous comparison of the computational performance in the 
three cases. We plot the computational time required for one iteration of the energy 
minimization algorithm of (Evcnbly and Vidal, 2009a) (during which all tensors in the 
MERA are updated once), as a function of the total bond dimension x for the cases of 
regular MERA, U(l) MERA and SU(2) MERA. We see that for sufficiently large x, using 
SU(2)-invariant tensors leads to a shorter time per iteration of the optimization algorithm. 
In the case of symmetric tensors we considered pre-computation of repeated operations, 
see Sec. 6.0.8. 



152 Implementation of non-Abelian symmetries II 



Chapter 7 

Conclusions and Outlook 



In this thesis we have described how to incorporate global internal symmetries into tensor 
network states and algorithms. 

On the theoretical side we developed a framework to characterize and manipulate sym- 
metric tensors. Any given tensor network can be adapted to the presence of a symmetry 
by imposing the constituent tensors to be symmetric. Symmetric tensors are very sparse 
objects. Their judicious use and careful manipulation can lead to an enormous compu- 
tational gain in numerical simulations. This has been extensively demonstrated in this 
thesis by means of our reference MATLAB implementation. 

On the implementation side, we have described a practical scheme for protecting and 
exploiting the symmetry in numerical simulations. We proposed the use of tree decom- 
positions of a symmetric tensor. Several advantages of this scheme were discussed, not 
excluding the overall simplicity and elegance of the method. We hope to have provided a 
suitable implementation framework for researchers who are familiar with the theoretical 
aspects of incorporating the symmetries into tensor network algorithm but nonetheless 
find the practical implementation challenging. 

In implementing symmetries we have gone beyond the case of MPS, which being a trivalent 
tensor network is simpler to handle. We described the construction of the U(l) and SU(2) 
symmetric versions of the MERA. Our Abelian implementation led to computational gains 
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measuring up to an increase of ten to twenty times. The analogous gain from the non- 
Abehan implementation was much larger, measuring up to an increase of forty to fifty 
times. These gains may be used either to reduce overall computation time or to permit 
substantial increases in the MERA bond dimension x, and consequently in the accuracy 
of the results obtained. Therefore the exploitation of symmetries, especially non-Abelian 
symmetries, can be an invaluable tool for numerically challenging systems. This is more so 
the case in two dimensional lattice models where simulation costs are much more severe. 
An example of a potential application is to a system of interacting fermions that appears 
in the context of high temperature conductivity. Here even though symmetries are present 
in the model, they have not been throughly exploited in the context of tensor network 
algorithms. 

Although we have given special attention to specific symmetry groups, U(l) and SU(2), the 
formalism presented in this thesis may equally well be applied to any reducible compact 
non-Abelian group that is multiplicity free. In particular, one can consider composite 
symmetries such as SU(2)xU(l), corresponding to spin isotropy and particle number 
conservation and SU(2)xSU(2) corresponding to conservation of spin and isospin etc. 
Such a symmetry is characterized by a set of charges (01,02,03,...); when fusing two 
such sets of charges (oi, 02, 03, . . .) and {a'^, O2, O3, . . .), each charge Oj is combined with its 
counterpart o'j according to the relevant fusion rule. Once again, this behaviour may be 
encoded into a single fusing tensor T'""". 

Our implementation scheme can also be readily extended to incorporate more general 
symmetry constraints such as those associated with conservation of total fermionic and 
anyonic charge. One proceeds by defining the following tensors for the relevant charges, 

• the fusing tensor T*"'° that encodes the fusion of two charges, 

• the recoupling coefficients F that relate various ways of fusing three charges, and 

• the swap tensor R^'"'^^ that encodes the swap behaviour of two charges. 

Note that within our specific implementation framework, one may instead just define the 
linear maps F that mediate tensor manipulations for the respective charges. 
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As an example, consider fermionic constraints where the relevant charge, p, is the parity 
of fermion particle number. Charge p takes two values, p = and p = 1 corresponding 
to even or odd number of fermions. The fusing tensor T '^"^^ encodes the fusion rules that 
specify how charges p and p' fuse together to obtain a charge p". These correspond to the 
fusion rules for the group Z2, given as, 

(p = 0)x(p' = 0)^(/ = 0), 
{p = 0)x{p' = l)^{p" = l), 
(p = l)x(p' = 0)^(/ = l), 
(p = 1) X {p' = 1) ^ (/ = 0). 

The recoupling coefficients Fp^p/^p^p^, associated with the fusion of three charges Pa,Pb and 
Pc are simple in this case owing to the Abelian fusion rules. They take a value Fp^p^p^p^ = 1 
for all values of intermediate charges pe and pf that appear when fusing the three charges 
one way or the other. 

The final ingredient is the tensor i? """''", which in this case is defined as, 

T~) swap 1 7~) swap -1 

-'i-p=oy=o-s>p"=o ~ -*-' ^p=o,p'=i^p"=i — -■-) 

rS sw^ap -1 tS swap -1 

-'i-p=iy=0-s>p"=i ~ -"-J -'i-p=i,p'=i->p"=o ""-■-• 

In a similar way, one can encode the corresponding fusion rules for anyonic charges into 
the fusing tensor T'""". In the case of anyons, the recoupling coefficients F are obtained as 
solutions to the pentagon equations whereas the tensors i^^^^'p are replaced with the any- 
onic braid operators that are obtained as solutions to the hexagon equations, see (Feiguin 
et al., 2007; Pfeifer et al., 2010; Trebst et al., 2008). Thus, having defined these tensors 
for the relevant charges, the formalism and the implementation framework presented in 
this thesis can be readily adapted to incorporate the constraints corresponding to the 
presence of fermionic or anyonic charges. 

In a different context, preservation of symmetry can be crucial even without demanding 
a computational gain. Recently, a novel classification of symmetric phases in ID gapped 
spin systems was undertaken in (Chen et al., 2011). In the absence of any symmetry, in 
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this classification all states are equivalent to trivial product states. However, by preserving 
certain symmetries many phases were reported to exist with a different symmetry protected 
topological order. As an alternative, such a classification could potentially be addressed 
with the symmetric version of the MERA, since the MERA is adept at characterizing 
fixed points of the renormalization group flow which correspond to different phases. 

Symmetries are a fundamental aspect of nature. Nearly all physical phenomenon can 
be explained by the presence or the absence of a symmetry. In numerical methods, the 
preservation of symmetries may well be a necessary requirement for simulating certain 
aspects of the system. As a computational aid, symmetries will play a crucial role in 
pushing forward the frontiers of tensor network algorithms in the coming years. 



References 



M. Aguado and G. Vidal. Phys. Rev. Lett, 100:070404, 2008 3 

P. W. Anderson. Science, 235.:1196, 1987 2 

J. Baez. Notes on quantum gravity, http://math.ucr.edu/home/haez/. 112 

T Barthel, C. Pineda, and J. Eisert. Phys. Rev. A, 80:042333, 2009 4 

S. Bergkvist, I. P. McCuUoch, and A. Rosengren. Phys. Rev. A, 74:053419, 2006 6 

J. D. Biamonte, S. R. Clark, and D. Jaksch. arXiv:1012.0531vl, 2010 112 

Z. Cai, L. Wang, X. C. Xie, and Y. Wang. Phys. Rev. A, 81:043602, 2010 6 

X. Chen, Z.-C. Gu, and X.-G. Wen. Phys. Rev. B, 83:035107, 2011 155 

L. Cincio, J. Dziarmaga, and M. M. Rams. Phys. Rev.Lett., 100:240603, 2008 3 

P. Corboz and G. Vidal. Phys. Rev. B, 80:165129, 2009 4 

P. Corboz, G. Evenbly, F. Verstraete, and G. Vidal. Phys. Rev. A, 81:010303(R), 2010a. 
4 

P. Corboz, R. Orus, B. Bauer, and G. Vidal. Phys. Rev. B, 81:165104, 2010b 4 

J. F. Cornwell. Group Theory in Physics. Academic Press, 1997 4, 6, 67, 93 

A.J. Daley, C. KoUath, U. SchoUwock, and G. Vidal. J.Stat. Mech. Theor. Exp., page 
P04005, 2004 3, 6 

A.J. Daley, S.R. Clark, D. Jaksch, and P. Zoller. Phys. Rev. A, 72:043618, 2005 6 

157 



158 References 

I. Danshita, J.E. Williams, C. A. R. Sa de Melo, and C. W. Clark. Phys. Rev. A, 76: 
043606, 2007 6 

G. Evenbly and G. Vidal. Phys. Rev. B, 79:144108, 2009a 3, 143, 144, 151 

G. Evenbly and G. Vidal. Phys. Rev. Lett, 102:180406, 2009b 3 

G. Evenbly and G. Vidal. Phys. Rev. B, 81:235102, 2010a 3 

G. Evenbly and G. Vidal. New J. Phys., 12:025007, 2010b 3 

H.G. Evertz. Adv. Phys., 52:1, 2003 1 

M. Pannes, B. Nachtergaele, and R. Werner. Commun. Math. Phys., 144:443, 1992. . . 3 

A. Feiguin, S. Trebst, A.W.W. Ludwig, M. Troyer, A. Kitaev, Z. Wang, and M. H. 
Freedman. Phys. Rev. Lett., 98:160409, 2007 155 

V. Giovannetti, S. Montangero, and R. R. Fazio. Phys. Rev. Lett, 101:180503, 2008. . 3 

Z.-C. Gu, M. Levin, and X.-G. Wen. Phys. Rev. B, 78:205116, 2008 3 

Z.-C. Gu, F. Verstraete, and X.-G. Wen. arXiv:1004.2563vl [cond-matstr-el], 2010. .. 4 

P. Henelius and A. W. Sandvik. Phys. Rev. B, 62:1102, 2000 1 

H. C. Jiang, Z. Y. Weng, and T. Xiang. Phys. Rev. Lett, 101:090603, 2008 3 

J. Jordan, R. Orus, G. Vidal, P. Verstraete, and J. I. Cirac. Phys. Rev. Lett., 101:250602, 
2008 3 

A. Y. Kitaev. Annals of Physics, 303:2, 2003 1 

R. Konig, B. W. Reichardt, and G. Vidal. Phys. Rev. B, 79:195123, 2009 3 

C. V. Kraus, N. Scliuch, P. Verstraete, and J. I. Cirac. Phys. Rev. A, 81:052338, 2010. 4 

E. Y. Loh and J. E. Gubernatis. Phys. Rev. B, 41:9301, 1990 1 

S.A. Major. American Journal of Physics, 67:972, 1999 25 

I. McCulloch. J. Stat. Mech., page P10014, 2007 6 



References 159 

I. P. McCuUoch. arXiv:0804.2509vl [cond-mat.str-el], 2008 2 

I. P. McCuUoch and M. Gulacsi. Europhys. Lett, 57:852, 2002 6 

R.V. Mishmash, I. Danshita, C. W. Clark, and L. D. Carr. Phys. Rev. A, 80:053612, 
2009 6 

V. Murg, F. Verstraete, and J. I. . Cirac. Phys. Rev. A, 75:033605, 2007 3 

V. Murg, F. Verstraete, and J. I. Cirac. Phys. Rev. B, 79:195119, 2009 3, 4 

V. Murg, O. Legeza, R. M. Noack, and F. Verstraete. Phys. Rev. B, 82:205105, 2010. . 3 

D. Muth, B. Schmidt, and M. Fleischhauer. New J. Phys., 12:083065, 2010 6 

C. Nayak, S. H. Simon, A. Stern, M. Freedman, and S.D. Sarma. Rev. Mod. Phys., 80: 
1083, 2008 1 

T. Nishino and K. Okunishi. J. Phys. Soc. Jpn., 67:3066, 1998 3 

Y. Nishio, N. Maeshima, A. Gendiar, and T. Nishino. arXiv:cond-mat/0401115vl, 2004. 
3 

S. Ostlund and S. Rommer. Phys. Rev. Lett., 75:3537, 1995 3, 6 

R. Penrose. Angular momentum: an approach to combinatorial space-time. 
http://math.ucr. edu/home/haez/penrose/, 1971 26 

D. Perez-Garcia, F. Verstraete, M.M. Wolf, and J. I. Cirac. Quantum Inf. Comput., 7: 
401, 2007 3 

D. Perez-Garcia, M.M Wolf, M. Sanz, F Verstraete, and J.I. Cirac. Phys. Rev. Lett, 100: 
167202, 2008 6 

R. N. C. Pfeifer, G. Evenbly, and G. Vidal. Phys. Rev. A, 79:040301 (R), 2009 3 

R.N.C Pfeifer, P. Corboz, O. Buerschaper, M. Aguado, M. Troyer, and G. Vidal. Physical 
Review B, 82:115126, 2010 155 

C. Pineda, T. Barthel, and J. Eisert. Phys. Rev. A, 81:050303(R), 2010 4 



160 References 

S. Pittel and N. Sandulescu. Phys. Rev. C, 73:014301, 2006 6 

I. Pizorn and F. Verstraete. Phys. Rev. B, 81:245110, 2010 4 

N. V. Prokofev, B. V. Svistunov, and I. S. Tupitsyn. Zh. Eks. Teor. Fiz., 114:570, 1998. 
1 

S. Ramasesha, S. K. Pati, H.R. Krishnamurthy, Z. Shuai, and J. L. Bredas. Phys. Rev. B, 
54:7598, 1996 6 

C. Rovelli. LivmgRev.Rel. 1:1, 1998 26 

C. Rovelli and L. Smolin. Phys. Rev. D, 53:5743, 1995 26 

S. Sachdev. Quantum Phase Transitions. Cambridge University Press, 1999 1 

J.J. Sakurai. Advanced Quantum Mechanics. Addison- Wesley Publishing Company, 1994. 
67 

A. W. Sandvik. Phys. Rev. Lett, 95:207203, 2005 1 

M. Sanz, M.M. Wolf, D. Perez-Garcia, and J.I. Cirac. Phys. Rev. A, 79:042308, 2009. 6 

U. Schollwock. Rev. Mod. Phys., 77:259, 2005a 2 

U. Schollwock. J. Phys. Soc. Jpn., 748:246, 2005b 3, 6 

Q.-Q. Shi, S.-H. Li, J.-H. Zhao, and H.-Q. Zhou. arXiv:0907.5520vl [cond-mat.str-el], 
2009 4 

Y. Y. Shi, L.-M. Duan, and G. Vidal. Phys. Rev. A, 74:022320, 2006 3 

G. Sierra and M.A. Martin-Delgado. arXiv:condmat/ 9811170v3, 1998 3 

G. Sierra and T. Nishino. Nucl. Phys. B, 495:505, 1997 6 

S. Singh, H.-Q. Zhou, and G. Vidal. New J. Phys., 12:033029, 2010a i, iii, 6 

Sukhwinder Singh, Robert N. C. Pfeifer, and Guifre Vidal. Phys. Rev. A, 82:050301 (R), 
2010b ii, iii 



References 161 

Sukhwinder Singh, Robert N. C Pfeifer, and Guifre Vidal. Phys. Rev. B, 83(11):115125, 
Mar 2011. doi: 10.1103/PhysRevB.83.115125 ii, iii 

O. F. Syljuasen and A. W. Sandvik. Phys. Rev. E, 66:046701, 2002 1 

L. Tagliacozzo, G. Evenbly, and G. Vidal. Phys. Rev. B, 80:235127, 2009 3 

W. Tatsuaki. Phys. Rev. E, 61:3199, 2000 6 

S Trebst, M. Troyer, Z. Wang, and A.W.W. Ludwig. Prog. Theor. Phys. Supp., 176:384, 
2008 155 

F. Verstraete and J. I. Cirac. arXiv:cond-mat/0407066vl, 2004 3 

G. Vidal. Phys. Rev. Lett, 91:147902, 2003 3 

G. Vidal. Phys. Rev. Lett, 93:040502, 2004 3, 6 

G. Vidal. Phys. Rev. Lett, 98:070201, 2007a 3, 6 

G. Vidal. Phys. Rev. Lett, 99:220405, 2007b 3 

G. Vidal. Phys. Rev. Lett, 101:110501, 2008 3 

G. Vidal. in Understanding Quantum Phase Transitions. Taylor & Francis, Boca Raton, 
2010 3 

S. R. White. Phys. Rev. Lett, 69:2863, 1992 2, 6 

S. R. White. Phys. Rev. B, 48:10345, 1993 2 

S.R. White and A.E. Feiguin. Phys. Rev. Lett, 93:076401, 2004 3, 6 

K. G. Wilson. Rev. Mod. Phys., 47:773, 1975 3 

Z. Y. Xie, H. C. Jiang, Q. N. Chen, Z. Y. Weng, and T. Xiang. Phys. Rev. Lett, 103: 
160601, 2009 3 



